Nov 03 07:54:26 devstack cinder-volume[75401]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 07:54:26 devstack cinder-volume[75401]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 07:54:26 devstack cinder-volume[75401]: we strongly recommend against using it for new projects.
Nov 03 07:54:26 devstack cinder-volume[75401]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 07:54:26 devstack cinder-volume[75401]: framework.  For more detail see
Nov 03 07:54:26 devstack cinder-volume[75401]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 07:54:26 devstack cinder-volume[75401]:   import eventlet  # noqa
Nov 03 07:54:29 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 07:54:29 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 07:54:29 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 07:54:30 devstack cinder-volume[75401]: INFO dbcounter [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Registered counter for database cinder
Nov 03 07:54:30 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:54:30 devstack cinder-volume[75401]: DEBUG dbcounter [-] [75401] Writer thread running {{(pid=75401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 07:54:30 devstack cinder-volume[75401]: INFO cinder.rpc [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 07:54:30 devstack cinder-volume[75401]: INFO cinder.rpc [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 07:54:30 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:54:31 devstack cinder-volume[75401]: INFO cinder.volume.manager [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Determined volume DB was empty at startup.
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG cinder.volume.manager [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75401) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 07:54:31 devstack cinder-volume[75401]: INFO cinder.volume.manager [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 03 07:54:31 devstack cinder-volume[75401]: WARNING stevedore.named [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 07:54:31 devstack cinder-volume[75401]: WARNING castellan.key_manager [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 07:54:31 devstack cinder-volume[75401]: WARNING cinder.keymgr.conf_key_mgr [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG cinder.volume.drivers.lvm [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75401) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_concurrency.processutils [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_concurrency.processutils [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] CMD "cinder-rtstool verify" returned: 0 in 0.427s {{(pid=75401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:54:31 devstack cinder-volume[75401]: INFO cinder.rpc [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 03 07:54:31 devstack cinder-volume[75401]: INFO cinder.rpc [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 03 07:54:31 devstack cinder-volume[75401]: WARNING stevedore.named [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 07:54:31 devstack cinder-volume[75401]: WARNING castellan.key_manager [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 07:54:31 devstack cinder-volume[75401]: INFO cinder.volume.manager [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:54:31 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Starting 1 workers
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Started child 75588 {{(pid=75401) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Full set of CONF: {{(pid=75401) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] ******************************************************************************** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Configuration options gathered from: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] ================================================================================ {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] allow_availability_zone_fallback = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] allow_compression_on_image_upload = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] allowed_direct_url_schemes     = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] api_rate_limit                 = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] auth_strategy                  = keystone {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] az_cache_duration              = 3600 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_availability_zone      = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_host                   = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_name                   = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_stats_polling_interval = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backup_api_class               = cinder.backup.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backup_name_template           = backup-%s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backup_use_same_host           = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backup_use_temp_snapshot       = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] chap_password                  = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] chap_username                  =  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cinder_internal_tenant_project_id = 0d4450880ed348a79c72eafe141804bd {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cinder_internal_tenant_user_id = b08542b294c640bbb5863ec655b539e6 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cloned_volume_same_az          = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cluster                        = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] compression_format             = gzip {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] config_dir                     = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] config_source                  = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] control_exchange               = openstack {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] debug                          = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75588]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] default_availability_zone      = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] default_group_type             = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] default_volume_type            = lvmdriver-1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] disk_geometry                  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] driver_client_cert             = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] driver_client_cert_key         = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] driver_data_namespace          = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] driver_ssl_cert_path           = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] driver_ssl_cert_verify         = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] driver_use_ssl                 = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] enable_force_upload            = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] enable_new_services            = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] enable_unsupported_driver      = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] enforce_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] filter_function                = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance_api_insecure            = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance_api_servers             = ['http://192.168.122.162/image'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance_api_ssl_compression     = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance_ca_certificates_file    = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance_certfile                = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance_keyfile                 = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance_num_retries             = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance_request_timeout         = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] goodness_function              = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] graceful_shutdown_timeout      = 5 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] group_api_class                = cinder.group.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] host                           = devstack {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_compress_on_upload       = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_conversion_address_space_limit = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_conversion_cpu_limit     = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_conversion_disable       = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_introspection_address_space_limit = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_introspection_cpu_limit  = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_upload_use_cinder_backend = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_upload_use_internal_tenant = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_volume_cache_enabled     = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_volume_cache_max_count   = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] image_volume_cache_max_size_gb = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] init_host_max_objects_retrieval = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] iscsi_target_flags             =  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] iscsi_write_cache              = on {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] iser_helper                    = tgtadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] iser_ip_address                = 192.168.122.162 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] iser_port                      = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] log_color                      = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] log_config_append              = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] log_dir                        = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] log_file                       = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] log_options                    = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] log_rotate_interval            = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] log_rotate_interval_type       = days {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] log_rotation_type              = none {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] max_age                        = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] max_logfile_count              = 30 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] max_logfile_size_mb            = 200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] max_over_subscription_ratio    = 20.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] message_reap_interval          = 86400 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] message_ttl                    = 2592000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] migration_create_volume_timeout_secs = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] monkey_patch                   = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] monkey_patch_modules           = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] my_ip                          = 192.168.122.162 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] no_snapshot_gb_quota           = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] num_iser_scan_tries            = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] num_shell_tries                = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] num_volume_device_scan_tries   = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] nvmeof_conn_info_version       = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] nvmet_ns_id                    = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] nvmet_port_id                  = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] osapi_max_limit                = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] osapi_volume_ext_list          = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] osapi_volume_listen_port       = 8776 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] osapi_volume_use_ssl           = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] osapi_volume_workers           = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] per_volume_size_limit          = -1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] periodic_fuzzy_delay           = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] periodic_interval              = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] public_endpoint                = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] publish_errors                 = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] quota_backup_gigabytes         = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] quota_backups                  = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] quota_gigabytes                = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] quota_groups                   = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] quota_snapshots                = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] quota_volumes                  = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] rate_limit_burst               = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] rate_limit_except_level        = CRITICAL {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] rate_limit_interval            = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] reinit_driver_count            = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] replication_device             = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] report_discard_supported       = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] report_interval                = 120 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] reservation_clean_interval     = 86400 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] reservation_expire             = 86400 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] reserved_image_namespaces      = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] reserved_percentage            = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] rpc_response_timeout           = 120 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] run_external_periodic_tasks    = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] scst_target_driver             = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] scst_target_iqn_name           = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_down_time              = 720 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] shell_completion               = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] snapshot_name_template         = snapshot-%s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] snapshot_same_host             = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] split_loggers                  = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] state_path                     = /opt/stack/data/cinder {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] storage_availability_zone      = nova {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] storage_protocol               = iSCSI {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] syslog_log_facility            = LOG_USER {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] target_helper                  = lioadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] target_ip_address              = 192.168.122.162 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] target_port                    = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] target_protocol                = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] target_secondary_ip_addresses  = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] trace_flags                    = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] transport_url                  = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] until_refresh                  = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] use_chap_auth                  = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] use_default_quota_class        = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] use_journal                    = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] use_json                       = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] use_multipath_for_image_xfer   = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] use_stderr                     = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] use_syslog                     = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] verify_glance_signatures       = enabled {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_api_class               = cinder.volume.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_backend_name            = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_clear                   = zero {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_clear_ionice            = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_clear_size              = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_copy_bps_limit          = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_dd_blocksize            = 1M {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_name_template           = volume-%s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_service_inithost_offload = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volume_usage_audit_period      = month {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] zoning_mode                    = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_concurrency.disable_process_locking = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.auth_section = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.auth_type   = password {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.auth_version = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.cache       = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.certfile    = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.include_service_catalog = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.insecure    = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.interface   = public {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.keyfile     = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75588]: INFO cinder.volume.manager [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcache_username = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.region_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.service_type = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.162/identity {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.backend                  = dogpile.cache.null {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.backend_argument         = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.backend_expiration_time  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.config_prefix            = cache.oslo {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.debug_cache_backend      = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.enable_retry_client      = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.enable_socket_keepalive  = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.enabled                  = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.expiration_time          = 600 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.hashclient_retry_attempts = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.memcache_dead_retry      = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.memcache_sasl_enabled    = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.password                 = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.proxies                  = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.redis_db                 = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.redis_server             = localhost:6379 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.retry_attempts           = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.retry_delay              = 0.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.socket_keepalive_count   = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.socket_keepalive_idle    = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.socket_keepalive_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.socket_timeout           = 1.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.tls_allowed_ciphers      = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.tls_cafile               = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.tls_certfile             = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.tls_enabled              = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.tls_keyfile              = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cache.username                 = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] coordination.backend_url       = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.asyncio_connection    = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.asyncio_slave_connection = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.backend               = sqlalchemy {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.connection            = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.connection_debug      = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.connection_parameters =  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.connection_recycle_time = 3600 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.connection_trace      = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.db_inc_retry_interval = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.db_max_retries        = 20 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.db_max_retry_interval = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.db_retry_interval     = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.max_overflow          = 50 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.max_pool_size         = 5 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.max_retries           = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.mysql_wsrep_sync_wait = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.pool_timeout          = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.retry_interval        = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.slave_connection      = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.sqlite_synchronous    = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.synchronous_reader    = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] database.use_db_reconnect      = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_tracing.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.059s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:31 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.connection_string     = messaging:// {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.enabled               = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.es_doc_type           = notification {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.es_scroll_size        = 10000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.es_scroll_time        = 2m {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.filter_error_trace    = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.hmac_keys             = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.sentinel_service_name = mymaster {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.socket_timeout        = 0.1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.trace_requests        = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler.trace_sqlalchemy      = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler_jaeger.process_tags   = {} {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler_jaeger.service_name_prefix = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] profiler_otlp.service_name_prefix = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_policy.enforce_new_defaults = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_policy.policy_default_rule = default {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] privsep_osbrick.group          = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] privsep_osbrick.helper_command = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] privsep_osbrick.user           = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cinder_sys_admin.group         = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cinder_sys_admin.helper_command = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] cinder_sys_admin.user          = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.auth_section      = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.auth_type         = password {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.cafile            = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.certfile          = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.collect_timing    = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.insecure          = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.keyfile           = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.send_service_user_token = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.split_loggers     = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.timeout           = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.tls_ciphers       = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] service_user.tls_min_version   = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.auth_section            = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.auth_type               = password {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.certfile                = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.collect_timing          = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.insecure                = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.keyfile                 = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.region_name             = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.split_loggers           = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.timeout                 = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.tls_ciphers             = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] glance.tls_min_version         = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.backend_availability_zone = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.chap_password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.chap_username =  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.disk_geometry = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.driver_client_cert = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.driver_client_cert_key = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.driver_data_namespace = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.driver_use_ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.extra_capabilities = {} {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.filter_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.goodness_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:31 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.iscsi_target_flags =  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.iscsi_write_cache = on {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.iser_ip_address = 192.168.122.162 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.iser_port     = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.lvm_share_target = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.lvm_type      = auto {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.num_shell_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.replication_device = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.report_discard_supported = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.reserved_percentage = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.target_helper = tgtadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.target_ip_address = 192.168.122.162 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.target_port   = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.target_protocol = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.trace_flags   = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.unique_fqdn_network = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.use_chap_auth = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.volume_backend_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.volume_clear  = zero {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.volume_clear_ionice = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.volume_clear_size = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_reports.file_event_handler = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_reports.log_dir           = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.backend_host       = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.chap_password      = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.chap_username      = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.disk_geometry      = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.driver_client_cert = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.extra_capabilities = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.filter_function    = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.goodness_function  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.iser_helper        = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.iser_port          = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.lvm_type           = auto {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.replication_device = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.report_discard_supported = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.reserved_percentage = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.scst_target_driver = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.storage_protocol   = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.target_ip_address  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.target_port        = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack sudo[75685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 03 07:54:32 devstack sudo[75685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.trace_flags        = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.volume_clear       = zero {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] lvmdriver-1.volumes_dir        = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_notifications.driver = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_notifications.retry = -1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] key_manager.fixed_key          = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.barbican_api_version  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.barbican_endpoint     = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.barbican_endpoint_type = public {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.barbican_region_name  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.cafile                = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.certfile              = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.collect_timing        = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.insecure              = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.keyfile               = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.number_of_retries     = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.retry_delay           = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.send_service_user_token = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.split_loggers         = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.timeout               = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.tls_ciphers           = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.tls_min_version       = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.verify_ssl            = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican.verify_ssl_path       = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.auth_section = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.auth_type = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.cafile   = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.collect_timing = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.keyfile  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.timeout  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.tls_ciphers = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] barbican_service_user.tls_min_version = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.approle_role_id          = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.approle_secret_id        = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.auth_method              = approle {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.auth_path                = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.kv_mountpoint            = secret {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.kv_path                  = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.kv_version               = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.namespace                = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.root_token_id            = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.ssl_ca_crt_file          = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.timeout                  = 60.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.token_file               = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.token_role               = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.use_ssl                  = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:54:32 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] ******************************************************************************** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 07:54:32 devstack sudo[75685]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.379s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:32 devstack sudo[75776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:54:32 devstack sudo[75776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:32 devstack sudo[75776]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.271s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 07:54:32 devstack cinder-volume[75588]: INFO cinder.brick.local_dev.lvm [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:32 devstack sudo[75889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 07:54:32 devstack sudo[75889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:32 devstack sudo[75889]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG cinder.brick.local_dev.lvm [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75588) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 03 07:54:32 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:32 devstack sudo[75982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:54:32 devstack sudo[75982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:34 devstack sudo[75982]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:34 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.486s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:34 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:34 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:34 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:34 devstack sudo[76270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:54:34 devstack sudo[76270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:34 devstack sudo[76270]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:34 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:34 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:34 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:34 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:34 devstack sudo[76329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 03 07:54:34 devstack sudo[76329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:35 devstack sudo[76329]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:35 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.277s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:35 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:35 devstack sudo[76332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 07:54:35 devstack sudo[76332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:35 devstack sudo[76332]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:35 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:35 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:35 devstack sudo[76335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 07:54:35 devstack sudo[76335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:35 devstack sudo[76335]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:35 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:35 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:35 devstack sudo[76338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:54:35 devstack sudo[76338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:35 devstack sudo[76338]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:35 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:35 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:35 devstack sudo[76341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:54:35 devstack sudo[76341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:36 devstack sudo[76341]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:36 devstack sudo[76351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:54:36 devstack sudo[76351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:36 devstack sudo[76351]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:36 devstack cinder-volume[75588]: INFO cinder.volume.drivers.lvm [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:36 devstack sudo[76355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:54:36 devstack sudo[76355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:36 devstack sudo[76355]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG cinder.volume.drivers.lvm [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Updating volume stats {{(pid=75588) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:36 devstack sudo[76358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 07:54:36 devstack sudo[76358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:36 devstack sudo[76358]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:36 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:37 devstack sudo[76363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:54:37 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:37 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:37 devstack sudo[76366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:54:37 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:37 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:37 devstack sudo[76370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:54:37 devstack sudo[76370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:37 devstack sudo[76370]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:37 devstack cinder-volume[75588]: INFO cinder.volume.driver [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG cinder.volume.driver [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75588) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG oslo_db.sqlalchemy.engines [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75588) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG dbcounter [-] [75588] Writer thread running {{(pid=75588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG cinder.db.api [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Building query based on filter {{(pid=75588) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG cinder.image.image_utils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75588) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 07:54:37 devstack cinder-volume[75588]: INFO cinder.keymgr.migration [None req-e3f47c4f-05a0-4430-b99b-951b2bd298eb None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG cinder.volume.drivers.lvm [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Updating volume stats {{(pid=75588) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 07:54:37 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:38 devstack sudo[76373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 07:54:38 devstack sudo[76373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:38 devstack sudo[76373]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:38 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:38 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:38 devstack sudo[76378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:54:38 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:38 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:38 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:38 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:38 devstack sudo[76381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:54:38 devstack sudo[76381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:38 devstack sudo[76381]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:38 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:38 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:38 devstack sudo[76385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:54:38 devstack sudo[76385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:39 devstack sudo[76385]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:39 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:39 devstack cinder-volume[75588]: DEBUG cinder.manager [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Notifying Schedulers of capabilities ... {{(pid=75588) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 07:54:39 devstack cinder-volume[75588]: INFO cinder.volume.manager [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Driver initialization completed successfully.
Nov 03 07:54:39 devstack cinder-volume[75588]: INFO cinder.manager [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Initiating service 2 cleanup
Nov 03 07:54:39 devstack cinder-volume[75588]: INFO cinder.manager [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Service 2 cleanup completed.
Nov 03 07:54:39 devstack cinder-volume[75588]: DEBUG cinder.service [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Creating RPC server for service cinder-volume {{(pid=75588) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 07:54:39 devstack cinder-volume[75588]: DEBUG cinder.service [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75588) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 07:54:39 devstack cinder-volume[75588]: INFO cinder.volume.manager [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 03 07:54:39 devstack cinder-volume[75588]: DEBUG cinder.volume.drivers.lvm [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Updating volume stats {{(pid=75588) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 07:54:39 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:39 devstack sudo[76391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 07:54:39 devstack sudo[76391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:39 devstack sudo[76391]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:39 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:39 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:39 devstack sudo[76394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:54:39 devstack sudo[76394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:39 devstack sudo[76394]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:39 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:39 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:39 devstack sudo[76402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:54:39 devstack sudo[76402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:40 devstack sudo[76402]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:40 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.403s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:40 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:54:40 devstack sudo[76412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:54:40 devstack sudo[76412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:54:40 devstack sudo[76412]: pam_unix(sudo:session): session closed for user root
Nov 03 07:54:40 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:54:40 devstack cinder-volume[75588]: INFO cinder.volume.manager [None req-55e73ecf-fff1-4d0c-bd51-46bb34df10a6 None None] Driver post RPC initialization completed successfully.
Nov 03 07:54:41 devstack cinder-volume[75401]: DEBUG dbcounter [-] [75401] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:54:50 devstack cinder-volume[75588]: DEBUG dbcounter [-] [75588] Writing DB stats cinder:SELECT=3 {{(pid=75588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:54:50 devstack cinder-volume[75588]: DEBUG dbcounter [-] [75588] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:55:24 devstack cinder-volume[75588]: DEBUG oslo_service.periodic_task [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running periodic task VolumeManager._thread_info {{(pid=75588) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 07:55:24 devstack cinder-volume[75588]: DEBUG cinder.volume.manager [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] thread count: 6 {{(pid=75588) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 07:55:24 devstack cinder-volume[75588]: DEBUG cinder.volume.manager [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] thread info: [<_MainThread(MainThread, started 132405224939648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132405111376576)>, <Thread(Thread-3 (stat_writer), started daemon 132405109871616)>, <Thread(Rabbit-heartbeat, started daemon 132405109503680)>, <Thread(Thread-5 (_runner), started daemon 132405109283200)>, <Thread(Thread-7 (_runner), started daemon 132405109383936)>] {{(pid=75588) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 07:56:24 devstack cinder-volume[75588]: DEBUG oslo_service.periodic_task [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75588) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 07:56:24 devstack cinder-volume[75588]: DEBUG cinder.volume.drivers.lvm [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Updating volume stats {{(pid=75588) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 07:56:24 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:56:24 devstack sudo[81939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 07:56:24 devstack sudo[81939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:56:24 devstack sudo[81939]: pam_unix(sudo:session): session closed for user root
Nov 03 07:56:24 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:56:24 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:56:24 devstack sudo[81942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:56:24 devstack sudo[81942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:56:25 devstack sudo[81942]: pam_unix(sudo:session): session closed for user root
Nov 03 07:56:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:56:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:56:25 devstack sudo[81945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:56:25 devstack sudo[81945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:56:25 devstack sudo[81945]: pam_unix(sudo:session): session closed for user root
Nov 03 07:56:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:56:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:56:25 devstack sudo[81948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:56:25 devstack sudo[81948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:56:25 devstack sudo[81948]: pam_unix(sudo:session): session closed for user root
Nov 03 07:56:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:56:25 devstack cinder-volume[75588]: DEBUG cinder.manager [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Notifying Schedulers of capabilities ... {{(pid=75588) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 07:56:25 devstack cinder-volume[75588]: DEBUG oslo_service.periodic_task [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running periodic task VolumeManager._thread_info {{(pid=75588) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 07:56:25 devstack cinder-volume[75588]: DEBUG cinder.volume.manager [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] thread count: 6 {{(pid=75588) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 07:56:25 devstack cinder-volume[75588]: DEBUG cinder.volume.manager [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] thread info: [<_MainThread(MainThread, started 132405224939648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132405111376576)>, <Thread(Thread-3 (stat_writer), started daemon 132405109871616)>, <Thread(Rabbit-heartbeat, started daemon 132405109503680)>, <Thread(Thread-5 (_runner), started daemon 132405109283200)>, <Thread(Thread-7 (_runner), started daemon 132405109383936)>] {{(pid=75588) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 07:56:50 devstack cinder-volume[75588]: DEBUG dbcounter [-] [75588] Writing DB stats cinder:SELECT=1 {{(pid=75588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:56:50 devstack cinder-volume[75588]: DEBUG dbcounter [-] [75588] Writing DB stats cinder:UPDATE=1 {{(pid=75588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:57:24 devstack cinder-volume[75588]: DEBUG oslo_service.periodic_task [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75588) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 07:57:24 devstack cinder-volume[75588]: DEBUG cinder.volume.drivers.lvm [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Updating volume stats {{(pid=75588) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 07:57:24 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:57:24 devstack sudo[83881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 07:57:24 devstack sudo[83881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:57:24 devstack sudo[83881]: pam_unix(sudo:session): session closed for user root
Nov 03 07:57:24 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:57:24 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:57:24 devstack sudo[83903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:57:24 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:57:25 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root
Nov 03 07:57:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:57:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:57:25 devstack sudo[83908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:57:25 devstack sudo[83908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:57:25 devstack sudo[83908]: pam_unix(sudo:session): session closed for user root
Nov 03 07:57:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:57:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:57:25 devstack sudo[83920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:57:25 devstack sudo[83920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:57:25 devstack sudo[83920]: pam_unix(sudo:session): session closed for user root
Nov 03 07:57:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:57:25 devstack cinder-volume[75588]: DEBUG cinder.manager [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Notifying Schedulers of capabilities ... {{(pid=75588) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 07:57:25 devstack cinder-volume[75588]: DEBUG oslo_service.periodic_task [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running periodic task VolumeManager._thread_info {{(pid=75588) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 07:57:25 devstack cinder-volume[75588]: DEBUG cinder.volume.manager [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] thread count: 6 {{(pid=75588) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 07:57:25 devstack cinder-volume[75588]: DEBUG cinder.volume.manager [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] thread info: [<_MainThread(MainThread, started 132405224939648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132405111376576)>, <Thread(Thread-3 (stat_writer), started daemon 132405109871616)>, <Thread(Rabbit-heartbeat, started daemon 132405109503680)>, <Thread(Thread-5 (_runner), started daemon 132405109283200)>, <Thread(Thread-7 (_runner), started daemon 132405109383936)>] {{(pid=75588) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 07:58:24 devstack cinder-volume[75588]: DEBUG oslo_service.periodic_task [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75588) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 07:58:24 devstack cinder-volume[75588]: DEBUG cinder.volume.drivers.lvm [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Updating volume stats {{(pid=75588) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 07:58:24 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:58:24 devstack sudo[85341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 07:58:24 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:58:24 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root
Nov 03 07:58:24 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:58:24 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:58:24 devstack sudo[85344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:58:24 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:58:25 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root
Nov 03 07:58:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:58:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:58:25 devstack sudo[85348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 07:58:25 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:58:25 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root
Nov 03 07:58:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:58:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:58:25 devstack sudo[85353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 07:58:25 devstack sudo[85353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:58:25 devstack sudo[85353]: pam_unix(sudo:session): session closed for user root
Nov 03 07:58:25 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:58:25 devstack cinder-volume[75588]: DEBUG cinder.manager [None req-a0a7749e-e4e8-4700-a403-a6e07fe64454 None None] Notifying Schedulers of capabilities ... {{(pid=75588) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 07:58:50 devstack cinder-volume[75588]: DEBUG dbcounter [-] [75588] Writing DB stats cinder:SELECT=1 {{(pid=75588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:58:50 devstack cinder-volume[75588]: DEBUG dbcounter [-] [75588] Writing DB stats cinder:UPDATE=1 {{(pid=75588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:58:53 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Caught SIGTERM, stopping children
Nov 03 07:58:53 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Acquiring lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 07:58:53 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Acquired lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 07:58:53 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Releasing lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 07:58:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Stop services. {{(pid=75401) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 03 07:58:53 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Killing children. {{(pid=75401) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 03 07:58:53 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Waiting on 1 children to exit
Nov 03 07:58:54 devstack cinder-volume[75588]: DEBUG oslo_concurrency.lockutils [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Acquiring lock "singleton_lock" {{(pid=75588) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 07:58:54 devstack cinder-volume[75588]: DEBUG oslo_concurrency.lockutils [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Acquired lock "singleton_lock" {{(pid=75588) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 07:58:54 devstack cinder-volume[75588]: DEBUG oslo_concurrency.lockutils [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Releasing lock "singleton_lock" {{(pid=75588) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 07:58:54 devstack cinder-volume[75588]: WARNING amqp [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 07:58:54 devstack cinder-volume[75588]: WARNING amqp [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 07:58:54 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-bb17caa8-5135-4ab6-8699-14adc31c3f05 None None] Child 75588 exited with status 0
Nov 03 07:58:54 devstack cinder-volume[85993]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 07:58:54 devstack cinder-volume[85993]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 07:58:54 devstack cinder-volume[85993]: we strongly recommend against using it for new projects.
Nov 03 07:58:54 devstack cinder-volume[85993]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 07:58:54 devstack cinder-volume[85993]: framework.  For more detail see
Nov 03 07:58:54 devstack cinder-volume[85993]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 07:58:54 devstack cinder-volume[85993]:   import eventlet  # noqa
Nov 03 07:58:56 devstack cinder-volume[85993]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 07:58:56 devstack cinder-volume[85993]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 07:58:56 devstack cinder-volume[85993]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 07:58:57 devstack cinder-volume[85993]: INFO dbcounter [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Registered counter for database cinder
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_db.sqlalchemy.engines [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG dbcounter [-] [85993] Writer thread running {{(pid=85993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 07:58:57 devstack cinder-volume[85993]: INFO cinder.rpc [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 07:58:57 devstack cinder-volume[85993]: INFO cinder.rpc [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_db.sqlalchemy.engines [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:58:57 devstack cinder-volume[85993]: INFO cinder.volume.manager [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Determined volume DB was empty at startup.
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG cinder.volume.manager [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85993) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 07:58:57 devstack cinder-volume[85993]: INFO cinder.volume.manager [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 03 07:58:57 devstack cinder-volume[85993]: WARNING stevedore.named [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 07:58:57 devstack cinder-volume[85993]: WARNING castellan.key_manager [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 07:58:57 devstack cinder-volume[85993]: WARNING cinder.keymgr.conf_key_mgr [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 07:58:57 devstack cinder-volume[85993]: INFO cinder.volume.manager [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_db.sqlalchemy.engines [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:58:57 devstack cinder-volume[85993]: INFO oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Starting 1 workers
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Started child 86210 {{(pid=85993) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Full set of CONF: {{(pid=85993) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] ******************************************************************************** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Configuration options gathered from: {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] ================================================================================ {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] allow_availability_zone_fallback = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] allow_compression_on_image_upload = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] allowed_direct_url_schemes     = [] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] api_rate_limit                 = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] auth_strategy                  = keystone {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_availability_zone      = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_host                   = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_name                   = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_stats_polling_interval = 60 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backup_api_class               = cinder.backup.api.API {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backup_name_template           = backup-%s {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backup_use_same_host           = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backup_use_temp_snapshot       = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] chap_password                  = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] chap_username                  =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cinder_internal_tenant_project_id = 0d4450880ed348a79c72eafe141804bd {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cinder_internal_tenant_user_id = b08542b294c640bbb5863ec655b539e6 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cluster                        = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] compression_format             = gzip {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] compute_api_class              = cinder.compute.nova.API {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] config_dir                     = [] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] config_source                  = [] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] control_exchange               = openstack {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] debug                          = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] default_availability_zone      = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] default_group_type             = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] default_volume_type            = QuobyteHD {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] disk_geometry                  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] driver_client_cert             = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] driver_client_cert_key         = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] driver_data_namespace          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] driver_ssl_cert_path           = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] driver_ssl_cert_verify         = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] driver_use_ssl                 = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] enable_new_services            = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] enable_unsupported_driver      = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] enabled_backends               = ['QuobyteHD'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] enforce_multipath_for_image_xfer = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] filter_function                = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance_api_insecure            = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance_api_servers             = ['http://192.168.122.162/image'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance_api_ssl_compression     = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance_ca_certificates_file    = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance_catalog_info            = image:glance:publicURL {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance_certfile                = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance_keyfile                 = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance_num_retries             = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance_request_timeout         = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] goodness_function              = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] graceful_shutdown_timeout      = 5 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] group_api_class                = cinder.group.api.API {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] host                           = devstack {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_compress_on_upload       = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_conversion_address_space_limit = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_conversion_cpu_limit     = 60 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_conversion_disable       = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_introspection_address_space_limit = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_introspection_cpu_limit  = 60 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_upload_use_cinder_backend = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_upload_use_internal_tenant = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_volume_cache_enabled     = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_volume_cache_max_count   = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] image_volume_cache_max_size_gb = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] init_host_max_objects_retrieval = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] instance_format                = [instance: %(uuid)s]  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[86210]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] iscsi_target_flags             =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] iscsi_write_cache              = on {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] iser_helper                    = tgtadm {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] iser_ip_address                = 192.168.122.162 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] iser_port                      = 3260 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] log_color                      = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] log_config_append              = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] log_dir                        = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] log_file                       = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] log_options                    = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] log_rotate_interval            = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] log_rotate_interval_type       = days {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] log_rotation_type              = none {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] max_age                        = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] max_logfile_count              = 30 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] max_logfile_size_mb            = 200 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] max_over_subscription_ratio    = 20.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] message_reap_interval          = 86400 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] message_ttl                    = 2592000 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] migration_create_volume_timeout_secs = 300 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] monkey_patch                   = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] monkey_patch_modules           = [] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] my_ip                          = 192.168.122.162 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] no_snapshot_gb_quota           = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] num_iser_scan_tries            = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] num_shell_tries                = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] num_volume_device_scan_tries   = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] nvmeof_conn_info_version       = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] nvmet_ns_id                    = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] nvmet_port_id                  = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] osapi_max_limit                = 1000 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] osapi_volume_ext_list          = [] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] osapi_volume_listen_port       = 8776 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] osapi_volume_use_ssl           = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] osapi_volume_workers           = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] per_volume_size_limit          = -1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] periodic_fuzzy_delay           = 60 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] periodic_interval              = 60 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] public_endpoint                = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] publish_errors                 = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] quota_backup_gigabytes         = 1000 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] quota_backups                  = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] quota_gigabytes                = 1000 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] quota_groups                   = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] quota_snapshots                = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] quota_volumes                  = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] rate_limit_burst               = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:57 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] rate_limit_except_level        = CRITICAL {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] rate_limit_interval            = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] reinit_driver_count            = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] replication_device             = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] report_discard_supported       = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] report_interval                = 120 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] reservation_clean_interval     = 86400 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] reservation_expire             = 86400 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] reserved_image_namespaces      = [] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] reserved_percentage            = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] rpc_response_timeout           = 120 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] run_external_periodic_tasks    = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] scst_target_driver             = iscsi {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] scst_target_iqn_name           = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_down_time              = 720 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] shell_completion               = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] snapshot_name_template         = snapshot-%s {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] split_loggers                  = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] state_path                     = /opt/stack/data/cinder {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] storage_availability_zone      = nova {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] storage_protocol               = iSCSI {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] syslog_log_facility            = LOG_USER {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] target_helper                  = lioadm {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] target_ip_address              = 192.168.122.162 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] target_port                    = 3260 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] target_protocol                = iscsi {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] target_secondary_ip_addresses  = [] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] trace_flags                    = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] transport_url                  = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] until_refresh                  = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] use_chap_auth                  = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] use_default_quota_class        = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] use_journal                    = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] use_json                       = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] use_multipath_for_image_xfer   = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] use_stderr                     = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] use_syslog                     = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] verify_glance_signatures       = enabled {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_api_class               = cinder.volume.api.API {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_backend_name            = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_clear                   = zero {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_clear_ionice            = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_clear_size              = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_copy_bps_limit          = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_dd_blocksize            = 1M {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_name_template           = volume-%s {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_service_inithost_offload = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volume_usage_audit_period      = month {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] zoning_mode                    = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_concurrency.disable_process_locking = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.auth_section = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.auth_type   = password {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.auth_version = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.cache       = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.certfile    = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.delay_auth_decision = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.http_connect_timeout = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.include_service_catalog = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.insecure    = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.interface   = public {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.keyfile     = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_password = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcache_username = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.region_name = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.service_token_roles_required = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.service_type = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.token_cache_time = 300 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.162/identity {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.backend                  = dogpile.cache.null {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.backend_argument         = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.backend_expiration_time  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.config_prefix            = cache.oslo {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.debug_cache_backend      = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.enable_retry_client      = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.enable_socket_keepalive  = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.enabled                  = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.expiration_time          = 600 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.hashclient_retry_attempts = 2 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.memcache_dead_retry      = 300 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.memcache_pool_maxsize    = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.memcache_sasl_enabled    = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.password                 = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.proxies                  = [] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.redis_db                 = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.redis_sentinel_service_name = mymaster {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.redis_server             = localhost:6379 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.retry_attempts           = 2 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.retry_delay              = 0.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.socket_keepalive_count   = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.socket_keepalive_idle    = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.socket_keepalive_interval = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.socket_timeout           = 1.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.tls_allowed_ciphers      = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.tls_cafile               = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.tls_certfile             = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.tls_enabled              = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.tls_keyfile              = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cache.username                 = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] coordination.backend_url       = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.asyncio_connection    = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.asyncio_slave_connection = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.backend               = sqlalchemy {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.connection            = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.connection_debug      = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.connection_parameters =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.connection_recycle_time = 3600 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.connection_trace      = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.db_inc_retry_interval = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.db_max_retries        = 20 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.db_max_retry_interval = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.db_retry_interval     = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.max_overflow          = 50 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.max_pool_size         = 5 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.max_retries           = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.mysql_wsrep_sync_wait = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.pool_timeout          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.retry_interval        = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.slave_connection      = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.sqlite_synchronous    = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.synchronous_reader    = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] database.use_db_reconnect      = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_tracing.insecure = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.connection_string     = messaging:// {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.enabled               = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.es_doc_type           = notification {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.es_scroll_size        = 10000 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.es_scroll_time        = 2m {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.filter_error_trace    = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.hmac_keys             = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.sentinel_service_name = mymaster {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.socket_timeout        = 0.1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.trace_requests        = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler.trace_sqlalchemy      = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler_jaeger.process_tags   = {} {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler_jaeger.service_name_prefix = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] profiler_otlp.service_name_prefix = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_policy.enforce_new_defaults = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_policy.policy_default_rule = default {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_policy.policy_file        = policy.yaml {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] privsep_osbrick.group          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] privsep_osbrick.helper_command = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] privsep_osbrick.user           = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cinder_sys_admin.group         = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cinder_sys_admin.helper_command = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] cinder_sys_admin.user          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.auth_section      = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.auth_type         = password {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.cafile            = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.certfile          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.collect_timing    = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.insecure          = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.keyfile           = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.send_service_user_token = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.split_loggers     = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.timeout           = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.tls_ciphers       = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] service_user.tls_min_version   = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.auth_section            = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.auth_type               = password {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.certfile                = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.collect_timing          = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.insecure                = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.keyfile                 = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.region_name             = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.split_loggers           = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.timeout                 = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.tls_ciphers             = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] glance.tls_min_version         = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.backend_availability_zone = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.chap_password = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.chap_username =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.disk_geometry = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.driver_client_cert = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.driver_client_cert_key = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.driver_data_namespace = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.driver_use_ssl = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.enable_unsupported_driver = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.extra_capabilities = {} {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.filter_function = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.goodness_function = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.iscsi_target_flags =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.iscsi_write_cache = on {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.iser_helper   = tgtadm {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.iser_ip_address = 192.168.122.162 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.iser_port     = 3260 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nas_host      =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nas_login     = admin {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nas_mount_options = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nas_password  = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nas_private_key =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nas_share_path =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.num_shell_tries = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.nvmet_port_id = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.quobyte_client_cfg = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.quobyte_volume_url = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.replication_device = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.report_discard_supported = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.reserved_percentage = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.scst_target_driver = iscsi {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.scst_target_iqn_name = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.storage_protocol = iSCSI {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.target_helper = tgtadm {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.target_ip_address = 192.168.122.162 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.target_port   = 3260 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[86210]: INFO cinder.volume.manager [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG cinder.volume.drivers.remotefs [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86210) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.target_protocol = iscsi {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.trace_flags   = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.unique_fqdn_network = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.use_chap_auth = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.volume_backend_name = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.volume_clear  = zero {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.volume_clear_ionice = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.volume_clear_size = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_reports.file_event_handler = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_reports.log_dir           = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.backend_availability_zone = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.backend_host         = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.chap_password        = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.chap_username        = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.chiscsi_conf         = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.disk_geometry        = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.driver_client_cert   = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.driver_client_cert_key = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.driver_data_namespace = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.driver_use_ssl       = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.extra_capabilities   = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.filter_function      = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.goodness_function    = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.iser_helper          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.iser_ip_address      = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.iser_port            = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.iser_target_prefix   = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nas_host             = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nas_login            = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nas_mount_options    = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nas_password         = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nas_private_key      = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nas_share_path       = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nas_ssh_port         = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.num_shell_tries      = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.nvmet_port_id        = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.replication_device   = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.report_discard_supported = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.reserved_percentage  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.scst_target_driver   = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.storage_protocol     = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.target_helper        = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.target_ip_address    = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.target_port          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.target_prefix        = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.target_protocol      = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.trace_flags          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.use_chap_auth        = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.volume_clear         = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.volume_clear_size    = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] QuobyteHD.volumes_dir          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.ssl      = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_notifications.driver = [] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_notifications.retry = -1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] oslo_messaging_notifications.transport_url = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] key_manager.fixed_key          = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86210) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 03 07:58:58 devstack cinder-volume[86210]: WARNING cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 03 07:58:58 devstack cinder-volume[86210]: WARNING cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.barbican_api_version  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.barbican_endpoint     = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.barbican_endpoint_type = public {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.barbican_region_name  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.cafile                = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.certfile              = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.collect_timing        = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.insecure              = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.keyfile               = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.number_of_retries     = 60 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.retry_delay           = 1 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.send_service_user_token = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Running cmd (subprocess): mount.quobyte {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.split_loggers         = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.timeout               = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.tls_ciphers           = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.tls_min_version       = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.verify_ssl            = True {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican.verify_ssl_path       = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.auth_section = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.auth_type = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.cafile   = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.certfile = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.collect_timing = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.insecure = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.keyfile  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.split_loggers = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.timeout  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.tls_ciphers = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] barbican_service_user.tls_min_version = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.approle_role_id          = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.approle_secret_id        = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.auth_method              = approle {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.auth_path                = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.kv_mountpoint            = secret {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.kv_path                  = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.kv_version               = 2 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.namespace                = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.root_token_id            = **** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.ssl_ca_crt_file          = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.timeout                  = 60.0 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.token_file               = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.token_role               = None {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.use_ssl                  = False {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:58:58 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] ******************************************************************************** {{(pid=85993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 07:58:58 devstack quobyte-client[86211]: Reading configuration file: /etc/quobyte/client.cfg
Nov 03 07:58:58 devstack quobyte-client[86211]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] CMD "mount.quobyte" returned: 1 in 0.132s {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86210) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 07:58:58 devstack cinder-volume[86210]: INFO cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 ...
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f -c /etc/quobyte/client-cinder.cfg {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:58:58 devstack sudo[86216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f -c /etc/quobyte/client-cinder.cfg
Nov 03 07:58:58 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:58:58 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.404s {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:58:58 devstack cinder-volume[86210]: INFO cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 succeeded
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86210) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.420s {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:58:58 devstack sudo[86318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 07:58:58 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:58:58 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.244s {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:58:58 devstack cinder-volume[86210]: INFO cinder.volume.driver [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 07:58:58 devstack cinder-volume[86210]: DEBUG cinder.volume.driver [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7431602478027, 'free_capacity_gb': 1773.7431602478027, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86210) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_db.sqlalchemy.engines [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG dbcounter [-] [86210] Writer thread running {{(pid=86210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG cinder.db.api [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Building query based on filter {{(pid=86210) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG cinder.image.image_utils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86210) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 07:58:59 devstack cinder-volume[86210]: INFO cinder.keymgr.migration [None req-f4e4a949-da11-4db7-bae4-ffa1258c7093 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86210) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86210) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:58:59 devstack sudo[86322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 07:58:59 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:58:59 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.236s {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG cinder.manager [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Notifying Schedulers of capabilities ... {{(pid=86210) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 07:58:59 devstack cinder-volume[86210]: INFO cinder.volume.manager [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Driver initialization completed successfully.
Nov 03 07:58:59 devstack cinder-volume[86210]: INFO cinder.manager [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Initiating service 3 cleanup
Nov 03 07:58:59 devstack cinder-volume[86210]: INFO cinder.manager [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Service 3 cleanup completed.
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG cinder.service [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Creating RPC server for service cinder-volume {{(pid=86210) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG cinder.service [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86210) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 07:58:59 devstack cinder-volume[86210]: INFO cinder.volume.manager [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86210) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG cinder.volume.drivers.quobyte [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86210) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:58:59 devstack sudo[86325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 07:58:59 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:58:59 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root
Nov 03 07:58:59 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.274s {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:58:59 devstack cinder-volume[86210]: INFO cinder.volume.manager [None req-d49fda61-d71f-4a02-9032-6f3a10dfb2fe None None] Driver post RPC initialization completed successfully.
Nov 03 07:59:04 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-2478f4ac-8aa2-45c6-83a2-75b7b1404a60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 07:59:04 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-2478f4ac-8aa2-45c6-83a2-75b7b1404a60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 07:59:04 devstack cinder-volume[86210]: DEBUG cinder.volume.drivers.quobyte [None req-2478f4ac-8aa2-45c6-83a2-75b7b1404a60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86210) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 07:59:04 devstack cinder-volume[86210]: DEBUG cinder.volume.drivers.quobyte [None req-2478f4ac-8aa2-45c6-83a2-75b7b1404a60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86210) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 07:59:04 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-2478f4ac-8aa2-45c6-83a2-75b7b1404a60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86210) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 07:59:04 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-2478f4ac-8aa2-45c6-83a2-75b7b1404a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:59:04 devstack sudo[86444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 07:59:04 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:59:04 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root
Nov 03 07:59:04 devstack cinder-volume[86210]: DEBUG oslo_concurrency.processutils [None req-2478f4ac-8aa2-45c6-83a2-75b7b1404a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.221s {{(pid=86210) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:59:04 devstack cinder-volume[86210]: DEBUG cinder.manager [None req-2478f4ac-8aa2-45c6-83a2-75b7b1404a60 None None] Notifying Schedulers of capabilities ... {{(pid=86210) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 07:59:07 devstack cinder-volume[85993]: INFO oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Caught SIGTERM, stopping children
Nov 03 07:59:07 devstack cinder-volume[85993]: DEBUG oslo_concurrency.lockutils [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Acquiring lock "singleton_lock" {{(pid=85993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 07:59:07 devstack cinder-volume[85993]: DEBUG oslo_concurrency.lockutils [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Acquired lock "singleton_lock" {{(pid=85993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 07:59:07 devstack cinder-volume[85993]: DEBUG oslo_concurrency.lockutils [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Releasing lock "singleton_lock" {{(pid=85993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 07:59:07 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Stop services. {{(pid=85993) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 03 07:59:07 devstack cinder-volume[85993]: DEBUG oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Killing children. {{(pid=85993) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 03 07:59:07 devstack cinder-volume[85993]: INFO oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Waiting on 1 children to exit
Nov 03 07:59:09 devstack cinder-volume[86210]: DEBUG dbcounter [-] [86210] Writing DB stats cinder:SELECT=2 {{(pid=86210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:59:09 devstack cinder-volume[86210]: DEBUG dbcounter [-] [86210] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:59:12 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Acquiring lock "singleton_lock" {{(pid=86210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 07:59:12 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Acquired lock "singleton_lock" {{(pid=86210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 07:59:12 devstack cinder-volume[86210]: DEBUG oslo_concurrency.lockutils [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Releasing lock "singleton_lock" {{(pid=86210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 07:59:12 devstack cinder-volume[86210]: WARNING amqp [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 07:59:12 devstack cinder-volume[86210]: WARNING amqp [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 07:59:12 devstack cinder-volume[85993]: INFO oslo_service.backend._eventlet.service [None req-d1a51d0d-e91b-4d2a-b724-12c189d5da5e None None] Child 86210 exited with status 0
Nov 03 07:59:13 devstack cinder-volume[86551]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 07:59:13 devstack cinder-volume[86551]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 07:59:13 devstack cinder-volume[86551]: we strongly recommend against using it for new projects.
Nov 03 07:59:13 devstack cinder-volume[86551]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 07:59:13 devstack cinder-volume[86551]: framework.  For more detail see
Nov 03 07:59:13 devstack cinder-volume[86551]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 07:59:13 devstack cinder-volume[86551]:   import eventlet  # noqa
Nov 03 07:59:15 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 07:59:15 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 07:59:15 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 07:59:16 devstack cinder-volume[86551]: INFO dbcounter [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Registered counter for database cinder
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG dbcounter [-] [86551] Writer thread running {{(pid=86551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 07:59:16 devstack cinder-volume[86551]: INFO cinder.rpc [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 07:59:16 devstack cinder-volume[86551]: INFO cinder.rpc [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:59:16 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Determined volume DB was empty at startup.
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG cinder.volume.manager [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86551) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 07:59:16 devstack cinder-volume[86551]: WARNING stevedore.named [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 07:59:16 devstack cinder-volume[86551]: WARNING castellan.key_manager [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 07:59:16 devstack cinder-volume[86551]: WARNING cinder.keymgr.conf_key_mgr [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 07:59:16 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:59:16 devstack cinder-volume[86551]: INFO oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Starting 1 workers
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Started child 86851 {{(pid=86551) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Full set of CONF: {{(pid=86551) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] ******************************************************************************** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] Configuration options gathered from: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] ================================================================================ {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 07:59:16 devstack cinder-volume[86851]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] allow_availability_zone_fallback = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] allow_compression_on_image_upload = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] allowed_direct_url_schemes     = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] api_rate_limit                 = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] auth_strategy                  = keystone {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_availability_zone      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_host                   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_name                   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_stats_polling_interval = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backup_api_class               = cinder.backup.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backup_name_template           = backup-%s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backup_use_same_host           = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backup_use_temp_snapshot       = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] chap_password                  = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] chap_username                  =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cinder_internal_tenant_project_id = 0d4450880ed348a79c72eafe141804bd {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cinder_internal_tenant_user_id = b08542b294c640bbb5863ec655b539e6 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cluster                        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] compression_format             = gzip {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] compute_api_class              = cinder.compute.nova.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] config_dir                     = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] config_source                  = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] control_exchange               = openstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] debug                          = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] default_availability_zone      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] default_group_type             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] default_volume_type            = QuobyteHD {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] disk_geometry                  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] driver_client_cert             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] driver_client_cert_key         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] driver_data_namespace          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] driver_ssl_cert_path           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] driver_ssl_cert_verify         = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] driver_use_ssl                 = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] enable_new_services            = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] enable_unsupported_driver      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] enabled_backends               = ['QuobyteHD'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] enforce_multipath_for_image_xfer = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] filter_function                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance_api_insecure            = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 03 07:59:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86851) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance_api_servers             = ['http://192.168.122.162/image'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance_api_ssl_compression     = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance_ca_certificates_file    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance_catalog_info            = image:glance:publicURL {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance_certfile                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance_keyfile                 = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance_num_retries             = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance_request_timeout         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] goodness_function              = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] graceful_shutdown_timeout      = 5 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] group_api_class                = cinder.group.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] host                           = devstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_compress_on_upload       = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_conversion_address_space_limit = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_conversion_cpu_limit     = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_conversion_disable       = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_introspection_address_space_limit = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_introspection_cpu_limit  = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_upload_use_cinder_backend = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_upload_use_internal_tenant = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_volume_cache_enabled     = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_volume_cache_max_count   = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] image_volume_cache_max_size_gb = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] init_host_max_objects_retrieval = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] instance_format                = [instance: %(uuid)s]  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] iscsi_target_flags             =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] iscsi_write_cache              = on {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] iser_helper                    = tgtadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] iser_ip_address                = 192.168.122.162 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] iser_port                      = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] log_color                      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] log_config_append              = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:16 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] log_dir                        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] log_file                       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] log_options                    = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] log_rotate_interval            = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] log_rotate_interval_type       = days {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] log_rotation_type              = none {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] max_age                        = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] max_logfile_count              = 30 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] max_logfile_size_mb            = 200 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] max_over_subscription_ratio    = 20.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] message_reap_interval          = 86400 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] message_ttl                    = 2592000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] migration_create_volume_timeout_secs = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] monkey_patch                   = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] monkey_patch_modules           = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] my_ip                          = 192.168.122.162 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] no_snapshot_gb_quota           = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] num_iser_scan_tries            = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] num_shell_tries                = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] num_volume_device_scan_tries   = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] nvmeof_conn_info_version       = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86851) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 03 07:59:17 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.quobyte [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 03 07:59:17 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.quobyte [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] nvmet_ns_id                    = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] nvmet_port_id                  = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] osapi_max_limit                = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Running cmd (subprocess): mount.quobyte {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] osapi_volume_ext_list          = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] osapi_volume_listen_port       = 8776 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] osapi_volume_use_ssl           = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] osapi_volume_workers           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] per_volume_size_limit          = -1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] periodic_fuzzy_delay           = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] periodic_interval              = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] public_endpoint                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] publish_errors                 = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] quota_backup_gigabytes         = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] quota_backups                  = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] quota_gigabytes                = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] quota_groups                   = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] quota_snapshots                = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] quota_volumes                  = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] rate_limit_burst               = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] rate_limit_except_level        = CRITICAL {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] rate_limit_interval            = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] reinit_driver_count            = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] replication_device             = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] report_discard_supported       = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] report_interval                = 120 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] reservation_clean_interval     = 86400 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] reservation_expire             = 86400 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] reserved_image_namespaces      = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] reserved_percentage            = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] rpc_response_timeout           = 120 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] run_external_periodic_tasks    = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] scst_target_driver             = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] scst_target_iqn_name           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_down_time              = 720 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] shell_completion               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] snapshot_name_template         = snapshot-%s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] split_loggers                  = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] state_path                     = /opt/stack/data/cinder {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] storage_availability_zone      = nova {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] storage_protocol               = iSCSI {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] syslog_log_facility            = LOG_USER {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] target_helper                  = lioadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] target_ip_address              = 192.168.122.162 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] target_port                    = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] target_protocol                = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] target_secondary_ip_addresses  = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] trace_flags                    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] transport_url                  = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] until_refresh                  = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] use_chap_auth                  = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] use_default_quota_class        = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] use_journal                    = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] use_json                       = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] use_multipath_for_image_xfer   = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] use_stderr                     = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] use_syslog                     = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] verify_glance_signatures       = enabled {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_api_class               = cinder.volume.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_backend_name            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_clear                   = zero {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_clear_ionice            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_clear_size              = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_copy_bps_limit          = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_dd_blocksize            = 1M {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_name_template           = volume-%s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_service_inithost_offload = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volume_usage_audit_period      = month {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] zoning_mode                    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_concurrency.disable_process_locking = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.auth_section = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.auth_type   = password {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.auth_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.cache       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.certfile    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.delay_auth_decision = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.http_connect_timeout = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.include_service_catalog = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.insecure    = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.interface   = public {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.keyfile     = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcache_username = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack quobyte-client[86852]: Reading configuration file: /etc/quobyte/client.cfg
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.region_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.service_token_roles_required = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.service_type = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack quobyte-client[86852]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.token_cache_time = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.162/identity {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.backend                  = dogpile.cache.null {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.backend_argument         = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.backend_expiration_time  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.config_prefix            = cache.oslo {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.debug_cache_backend      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.enable_retry_client      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.enable_socket_keepalive  = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.enabled                  = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.expiration_time          = 600 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.hashclient_retry_attempts = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.memcache_dead_retry      = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.memcache_pool_maxsize    = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.memcache_sasl_enabled    = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.password                 = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.proxies                  = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.redis_db                 = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.redis_sentinel_service_name = mymaster {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.redis_server             = localhost:6379 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.retry_attempts           = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.retry_delay              = 0.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.socket_keepalive_count   = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.socket_keepalive_idle    = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.socket_keepalive_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.socket_timeout           = 1.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.tls_allowed_ciphers      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.tls_cafile               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.tls_certfile             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.tls_enabled              = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.tls_keyfile              = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cache.username                 = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] coordination.backend_url       = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.asyncio_connection    = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.asyncio_slave_connection = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.backend               = sqlalchemy {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.connection            = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.connection_debug      = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.connection_parameters =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.connection_recycle_time = 3600 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.connection_trace      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.db_inc_retry_interval = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.db_max_retries        = 20 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.db_max_retry_interval = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.db_retry_interval     = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.max_overflow          = 50 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.max_pool_size         = 5 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.max_retries           = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.mysql_wsrep_sync_wait = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.pool_timeout          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.retry_interval        = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.slave_connection      = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.sqlite_synchronous    = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.synchronous_reader    = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] database.use_db_reconnect      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_tracing.insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.connection_string     = messaging:// {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.enabled               = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.es_doc_type           = notification {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.es_scroll_size        = 10000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.es_scroll_time        = 2m {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.filter_error_trace    = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.hmac_keys             = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.sentinel_service_name = mymaster {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.socket_timeout        = 0.1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.trace_requests        = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler.trace_sqlalchemy      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler_jaeger.process_tags   = {} {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler_jaeger.service_name_prefix = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] profiler_otlp.service_name_prefix = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_policy.enforce_new_defaults = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_policy.policy_default_rule = default {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack sudo[86856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_policy.policy_file        = policy.yaml {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] privsep_osbrick.group          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] privsep_osbrick.helper_command = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] privsep_osbrick.user           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cinder_sys_admin.group         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cinder_sys_admin.helper_command = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] cinder_sys_admin.user          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.auth_section      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.auth_type         = password {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.cafile            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.certfile          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.collect_timing    = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.insecure          = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.keyfile           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.send_service_user_token = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.split_loggers     = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.timeout           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.tls_ciphers       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] service_user.tls_min_version   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.auth_section            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.auth_type               = password {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.certfile                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.collect_timing          = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.insecure                = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.keyfile                 = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.region_name             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.split_loggers           = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.timeout                 = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.tls_ciphers             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] glance.tls_min_version         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.backend_availability_zone = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.chap_password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.chap_username =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.disk_geometry = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.driver_client_cert = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.driver_client_cert_key = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.driver_data_namespace = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.driver_use_ssl = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.enable_unsupported_driver = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.extra_capabilities = {} {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.filter_function = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.goodness_function = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.iscsi_target_flags =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.iscsi_write_cache = on {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.iser_helper   = tgtadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.iser_ip_address = 192.168.122.162 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.iser_port     = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nas_host      =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nas_login     = admin {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nas_mount_options = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nas_password  = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nas_private_key =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nas_share_path =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.num_shell_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.nvmet_port_id = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.quobyte_client_cfg = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.quobyte_volume_url = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.replication_device = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.report_discard_supported = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.reserved_percentage = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.scst_target_driver = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.scst_target_iqn_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.storage_protocol = iSCSI {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.target_helper = tgtadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.target_ip_address = 192.168.122.162 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.target_port   = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.target_protocol = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.trace_flags   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.unique_fqdn_network = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.use_chap_auth = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.volume_backend_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.volume_clear  = zero {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.volume_clear_ionice = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.volume_clear_size = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_reports.file_event_handler = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_reports.log_dir           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.backend_availability_zone = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.backend_host         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.chap_password        = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.chap_username        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.chiscsi_conf         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.disk_geometry        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.driver_client_cert   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.driver_client_cert_key = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.driver_data_namespace = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.driver_use_ssl       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.extra_capabilities   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.filter_function      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.goodness_function    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.iser_helper          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.iser_ip_address      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.iser_port            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.iser_target_prefix   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nas_host             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nas_login            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nas_mount_options    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nas_password         = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nas_private_key      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nas_share_path       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nas_ssh_port         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.num_shell_tries      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.nvmet_port_id        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.replication_device   = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.report_discard_supported = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.reserved_percentage  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.scst_target_driver   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.storage_protocol     = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.target_helper        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.target_ip_address    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.target_port          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.target_prefix        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.target_protocol      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.trace_flags          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.use_chap_auth        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.volume_clear         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.volume_clear_size    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] QuobyteHD.volumes_dir          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.ssl      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_notifications.driver = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_notifications.retry = -1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] oslo_messaging_notifications.transport_url = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] key_manager.fixed_key          = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.barbican_api_version  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.barbican_endpoint     = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.barbican_endpoint_type = public {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.barbican_region_name  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.cafile                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.certfile              = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.collect_timing        = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.insecure              = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.keyfile               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.number_of_retries     = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.retry_delay           = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.send_service_user_token = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.split_loggers         = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.timeout               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.tls_ciphers           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.tls_min_version       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.verify_ssl            = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican.verify_ssl_path       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.auth_section = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.auth_type = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.cafile   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.collect_timing = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.keyfile  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.split_loggers = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.timeout  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.tls_ciphers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] barbican_service_user.tls_min_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.approle_role_id          = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.approle_secret_id        = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.auth_method              = approle {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.auth_path                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.kv_mountpoint            = secret {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.kv_path                  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.kv_version               = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.namespace                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.root_token_id            = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.ssl_ca_crt_file          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.timeout                  = 60.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.token_file               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.token_role               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.use_ssl                  = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 07:59:17 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-101c3635-3b8d-4066-8ea9-1b4838f569ec None None] ******************************************************************************** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 07:59:17 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.271s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:59:17 devstack cinder-volume[86851]: INFO cinder.volume.driver [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.volume.driver [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7431602478027, 'free_capacity_gb': 1773.7431602478027, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86851) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_db.sqlalchemy.engines [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86851) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writer thread running {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.db.api [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Building query based on filter {{(pid=86851) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86851) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:59:17 devstack cinder-volume[86851]: INFO cinder.keymgr.migration [None req-0842d6a6-6ec5-4534-9b78-2e9fdf068d52 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 07:59:17 devstack sudo[86867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 07:59:17 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:59:17 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.241s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 07:59:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Driver initialization completed successfully.
Nov 03 07:59:17 devstack cinder-volume[86851]: INFO cinder.manager [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Initiating service 3 cleanup
Nov 03 07:59:17 devstack cinder-volume[86851]: INFO cinder.manager [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Service 3 cleanup completed.
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.service [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Creating RPC server for service cinder-volume {{(pid=86851) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.service [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86851) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 07:59:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 07:59:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 07:59:17 devstack sudo[86878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 07:59:17 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 07:59:18 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root
Nov 03 07:59:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 07:59:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-510fa4b0-b2a4-47ef-ab60-772082d45abf None None] Driver post RPC initialization completed successfully.
Nov 03 07:59:26 devstack cinder-volume[86551]: DEBUG dbcounter [-] [86551] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:59:27 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 07:59:28 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:00:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:00:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 6 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:00:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Flow 'volume_create_manager' (42d824df-6ca0-4f10-822a-cbe048630c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8222608-d6a2-48fa-8d02-98ba19dc0d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8222608-d6a2-48fa-8d02-98ba19dc0d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-775948623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05db5b79-40b5-439b-9c35-0a8e416e60dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2176ba546c94a5aa60607bfc78c2924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:00:16Z,use_quota=True,user_id='d591b5c2314346c88213878e3c88b61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac308479-5dee-4c6f-ab59-3b445acbc2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac308479-5dee-4c6f-ab59-3b445acbc2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ae7737-bf2c-46bc-9f8a-47fe4ea9a57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ae7737-bf2c-46bc-9f8a-47fe4ea9a57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05db5b79-40b5-439b-9c35-0a8e416e60dd', 'volume_name': 'volume-05db5b79-40b5-439b-9c35-0a8e416e60dd', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bcbd13-9e9c-4714-ae41-b120ea8b0ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bcbd13-9e9c-4714-ae41-b120ea8b0ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a7e88b-3404-4235-a9df-23034c7dab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:16 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Volume 05db5b79-40b5-439b-9c35-0a8e416e60dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05db5b79-40b5-439b-9c35-0a8e416e60dd', 'volume_size': 1}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-775948623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05db5b79-40b5-439b-9c35-0a8e416e60dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2176ba546c94a5aa60607bfc78c2924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:00:16Z,use_quota=True,user_id='d591b5c2314346c88213878e3c88b61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Creating volume 05db5b79-40b5-439b-9c35-0a8e416e60dd {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:00:16 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:00:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:00:16 devstack sudo[87290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd 1073741824
Nov 03 08:00:16 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:00:17 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root
Nov 03 08:00:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd 1073741824" returned: 0 in 0.617s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:00:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:00:17 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd
Nov 03 08:00:17 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:00:17 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Nov 03 08:00:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd" returned: 0 in 0.324s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:00:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:00:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:00:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a7e88b-3404-4235-a9df-23034c7dab45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05db5b79-40b5-439b-9c35-0a8e416e60dd', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d25754-8654-48b7-8fb1-5ee12f87b02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:17 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Volume volume-05db5b79-40b5-439b-9c35-0a8e416e60dd (05db5b79-40b5-439b-9c35-0a8e416e60dd): created successfully
Nov 03 08:00:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d25754-8654-48b7-8fb1-5ee12f87b02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Flow 'volume_create_manager' (42d824df-6ca0-4f10-822a-cbe048630c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:00:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ce0dfa43-ba45-4ebc-bed8-1a09cb4b40cf tempest-TaggedAttachmentsTest-2023730401 None] Created volume successfully.
Nov 03 08:00:27 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:00:27 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Flow 'volume_create_manager' (07eb2e41-9435-4818-96b9-8f2d7348b071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d832ce87-912f-435c-9850-285886a35f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d832ce87-912f-435c-9850-285886a35f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1202223870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8543c968-c2c9-4543-b194-9bbbb0f49604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee85a8ba267f4ce4a8c385401b89330e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:00:49Z,use_quota=True,user_id='8f55f1c66b3e485b9c0ca56b6619acef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bd4cf8-1769-46dc-bd58-ccb45169f177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bd4cf8-1769-46dc-bd58-ccb45169f177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce18ca99-89ff-4037-91bc-1a5b75a1a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce18ca99-89ff-4037-91bc-1a5b75a1a503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8543c968-c2c9-4543-b194-9bbbb0f49604', 'volume_name': 'volume-8543c968-c2c9-4543-b194-9bbbb0f49604', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6c6e44-2d02-4c6c-a1c8-819ea2db4e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6c6e44-2d02-4c6c-a1c8-819ea2db4e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d33f7a-1964-4448-8f88-d731da08920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:48 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Volume 8543c968-c2c9-4543-b194-9bbbb0f49604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8543c968-c2c9-4543-b194-9bbbb0f49604', 'volume_size': 1}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1202223870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8543c968-c2c9-4543-b194-9bbbb0f49604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee85a8ba267f4ce4a8c385401b89330e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:00:49Z,use_quota=True,user_id='8f55f1c66b3e485b9c0ca56b6619acef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:00:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Creating volume 8543c968-c2c9-4543-b194-9bbbb0f49604 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:00:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:00:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:00:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:00:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:00:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:00:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:00:49 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:00:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:00:49 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604 1073741824
Nov 03 08:00:49 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:00:49 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Nov 03 08:00:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604 1073741824" returned: 0 in 0.744s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:00:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:00:49 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604
Nov 03 08:00:49 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:00:50 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Nov 03 08:00:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604" returned: 0 in 0.702s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:00:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:00:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:00:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d33f7a-1964-4448-8f88-d731da08920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8543c968-c2c9-4543-b194-9bbbb0f49604', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a754004-9218-404e-9409-f3ca5a81de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:50 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Volume volume-8543c968-c2c9-4543-b194-9bbbb0f49604 (8543c968-c2c9-4543-b194-9bbbb0f49604): created successfully
Nov 03 08:00:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a754004-9218-404e-9409-f3ca5a81de1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Flow 'volume_create_manager' (07eb2e41-9435-4818-96b9-8f2d7348b071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:00:50 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-064d67db-de25-4fd6-9950-f0fd29c22075 tempest-ServerActionsTestOtherA-1011024138 None] Created volume successfully.
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Flow 'volume_create_manager' (392df869-e588-41d4-bf7e-ee13299f3869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68db7189-9dd5-46c6-a383-6b69e8c2caa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68db7189-9dd5-46c6-a383-6b69e8c2caa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2073842944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92af681-1b03-499f-a798-c027c4db9575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83f88033ba943368ef8712c03d07dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:00:51Z,use_quota=True,user_id='5cfa4374213e42129907193b1d889f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f4aed3-3073-4c91-8cbc-7e33430235b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f4aed3-3073-4c91-8cbc-7e33430235b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678a6c9a-7d84-4553-bafd-b8b5139e197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678a6c9a-7d84-4553-bafd-b8b5139e197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd92af681-1b03-499f-a798-c027c4db9575', 'volume_name': 'volume-d92af681-1b03-499f-a798-c027c4db9575', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c85d91d-b5ab-4ab8-9a89-1dcbd80a3214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c85d91d-b5ab-4ab8-9a89-1dcbd80a3214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7220bde1-6c40-4d0e-95f9-c348edc0a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:51 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Volume d92af681-1b03-499f-a798-c027c4db9575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d92af681-1b03-499f-a798-c027c4db9575', 'volume_size': 1}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2073842944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92af681-1b03-499f-a798-c027c4db9575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83f88033ba943368ef8712c03d07dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:00:51Z,use_quota=True,user_id='5cfa4374213e42129907193b1d889f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Creating volume d92af681-1b03-499f-a798-c027c4db9575 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:00:51 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:00:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:00:51 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575 1073741824
Nov 03 08:00:51 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:00:52 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Nov 03 08:00:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575 1073741824" returned: 0 in 0.700s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:00:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:00:52 devstack sudo[88063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575
Nov 03 08:00:52 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:00:52 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root
Nov 03 08:00:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575" returned: 0 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:00:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:00:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:00:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7220bde1-6c40-4d0e-95f9-c348edc0a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d92af681-1b03-499f-a798-c027c4db9575', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f423452-3258-4f13-a0a4-26d769b37023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:00:52 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Volume volume-d92af681-1b03-499f-a798-c027c4db9575 (d92af681-1b03-499f-a798-c027c4db9575): created successfully
Nov 03 08:00:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f423452-3258-4f13-a0a4-26d769b37023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:00:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Flow 'volume_create_manager' (392df869-e588-41d4-bf7e-ee13299f3869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:00:52 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ddc67f98-fbc4-4d3a-888a-469e67ad1fbc tempest-AttachVolumeShelveTestJSON-1699128690 None] Created volume successfully.
Nov 03 08:01:02 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:DELETE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:01:02 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:03 devstack sudo[88159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:01:03 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:03 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.381s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 6 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:01:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:01:08 devstack cinder-volume[86851]: WARNING py.warnings [req-106977df-7143-4686-9dc7-6941dc26b16f req-46b800e4-3e35-4410-bcc0-9310f636f70c tempest-AttachVolumeShelveTestJSON-1699128690 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Nov 03 08:01:08 devstack cinder-volume[86851]:   .first()
Nov 03 08:01:08 devstack cinder-volume[86851]: 
Nov 03 08:01:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-106977df-7143-4686-9dc7-6941dc26b16f req-46b800e4-3e35-4410-bcc0-9310f636f70c tempest-AttachVolumeShelveTestJSON-1699128690 None] No connector for attachment c4d0864c-ba97-47fc-a598-0e79de1be8a3; skipping storage backend terminate_connection call. {{(pid=86851) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 03 08:01:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-106977df-7143-4686-9dc7-6941dc26b16f req-46b800e4-3e35-4410-bcc0-9310f636f70c tempest-AttachVolumeShelveTestJSON-1699128690 None] Deleting attachment c4d0864c-ba97-47fc-a598-0e79de1be8a3. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:01:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fd43ba79-1f61-40e8-93e2-e2cddc4a1bc9 req-a194cb89-5389-4999-a524-140e97e88a09 tempest-TaggedAttachmentsTest-2023730401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:01:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fd43ba79-1f61-40e8-93e2-e2cddc4a1bc9 req-a194cb89-5389-4999-a524-140e97e88a09 tempest-TaggedAttachmentsTest-2023730401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:01:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fd43ba79-1f61-40e8-93e2-e2cddc4a1bc9 req-a194cb89-5389-4999-a524-140e97e88a09 tempest-TaggedAttachmentsTest-2023730401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:01:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-fd43ba79-1f61-40e8-93e2-e2cddc4a1bc9 req-a194cb89-5389-4999-a524-140e97e88a09 tempest-TaggedAttachmentsTest-2023730401 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-05db5b79-40b5-439b-9c35-0a8e416e60dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d7d7b3c-0eb2-49d3-8827-2864bb81ddda', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:01:21 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-fd43ba79-1f61-40e8-93e2-e2cddc4a1bc9 req-a194cb89-5389-4999-a524-140e97e88a09 tempest-TaggedAttachmentsTest-2023730401 None] attachment_update completed successfully.
Nov 03 08:01:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-2abb11fd-d036-4419-8cd9-945d436e90c2 req-565cbddd-4268-413f-9660-2edd9256b6ef tempest-TaggedAttachmentsTest-2023730401 None] Terminate volume connection completed successfully.
Nov 03 08:01:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-2abb11fd-d036-4419-8cd9-945d436e90c2 req-565cbddd-4268-413f-9660-2edd9256b6ef tempest-TaggedAttachmentsTest-2023730401 None] Deleting attachment 8d7d7b3c-0eb2-49d3-8827-2864bb81ddda. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:01:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-b6168926-59f0-4181-b918-42743e374e7d req-1fccb3c1-4dba-4c1d-9d4d-0bb9a4642004 tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:01:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-b6168926-59f0-4181-b918-42743e374e7d req-1fccb3c1-4dba-4c1d-9d4d-0bb9a4642004 tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:01:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-b6168926-59f0-4181-b918-42743e374e7d req-1fccb3c1-4dba-4c1d-9d4d-0bb9a4642004 tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:01:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-b6168926-59f0-4181-b918-42743e374e7d req-1fccb3c1-4dba-4c1d-9d4d-0bb9a4642004 tempest-ServerActionsTestOtherA-1011024138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-8543c968-c2c9-4543-b194-9bbbb0f49604', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6827fa93-b627-4093-8b5f-4063ed77265d', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:01:34 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-b6168926-59f0-4181-b918-42743e374e7d req-1fccb3c1-4dba-4c1d-9d4d-0bb9a4642004 tempest-ServerActionsTestOtherA-1011024138 None] attachment_update completed successfully.
Nov 03 08:01:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Acquiring lock "cinder-05db5b79-40b5-439b-9c35-0a8e416e60dd-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:01:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Lock "cinder-05db5b79-40b5-439b-9c35-0a8e416e60dd-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:01:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Acquiring lock "cinder-quobyte-05db5b79-40b5-439b-9c35-0a8e416e60dd" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:01:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Lock "cinder-quobyte-05db5b79-40b5-439b-9c35-0a8e416e60dd" acquired by "delete_volume" :: waited 0.051s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:01:38 devstack cinder-volume[86851]: INFO oslo.privsep.daemon [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0e1szi_g/privsep.sock']
Nov 03 08:01:38 devstack sudo[89517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0e1szi_g/privsep.sock
Nov 03 08:01:38 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Flow 'volume_create_manager' (6c099b77-5599-49fb-8a70-611d4041e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9109726c-48a4-4362-a6fd-b6165d6c1bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9109726c-48a4-4362-a6fd-b6165d6c1bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-118648391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8478d74-b132-42bc-a4a3-a803f30449f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aade33f94829431fa368593fb1cd714c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:01:39Z,use_quota=True,user_id='f9374a0cd5eb469dacc6bb27063d4f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121a50ec-7d6b-4234-84fc-74d678578563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121a50ec-7d6b-4234-84fc-74d678578563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978c0e90-c577-41fe-b40a-ad0cdb93c71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978c0e90-c577-41fe-b40a-ad0cdb93c71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8478d74-b132-42bc-a4a3-a803f30449f7', 'volume_name': 'volume-e8478d74-b132-42bc-a4a3-a803f30449f7', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd96b5bd-7154-4ea3-8a49-65b33bed67e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd96b5bd-7154-4ea3-8a49-65b33bed67e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fceb0d-a9a5-4589-a738-be92714b9df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:01:39 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Volume e8478d74-b132-42bc-a4a3-a803f30449f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8478d74-b132-42bc-a4a3-a803f30449f7', 'volume_size': 1}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-118648391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8478d74-b132-42bc-a4a3-a803f30449f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aade33f94829431fa368593fb1cd714c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:01:39Z,use_quota=True,user_id='f9374a0cd5eb469dacc6bb27063d4f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Creating volume e8478d74-b132-42bc-a4a3-a803f30449f7 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:01:39 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:01:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:39 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7 1073741824
Nov 03 08:01:39 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:40 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7 1073741824" returned: 0 in 0.940s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:40 devstack sudo[89535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7
Nov 03 08:01:40 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:40 devstack cinder-volume[86851]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 03 08:01:40 devstack cinder-volume[86851]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 08:01:40 devstack cinder-volume[86851]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 03 08:01:40 devstack cinder-volume[86851]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 03 08:01:40 devstack cinder-volume[86851]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 03 08:01:40 devstack cinder-volume[86851]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 03 08:01:40 devstack cinder-volume[86851]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 08:01:40 devstack cinder-volume[86851]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 03 08:01:40 devstack cinder-volume[86851]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 03 08:01:40 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7" returned: 0 in 0.288s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fceb0d-a9a5-4589-a738-be92714b9df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8478d74-b132-42bc-a4a3-a803f30449f7', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b924ff-a8d2-4c41-8cff-d8626919fc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:01:40 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:40 devstack cinder-volume[86851]: INFO oslo.privsep.daemon [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Spawned new privsep daemon via rootwrap
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Accepted privsep connection to /tmp/tmp0e1szi_g/privsep.sock {{(pid=86851) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 03 08:01:40 devstack cinder-volume[86851]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 08:01:40 devstack cinder-volume[86851]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 08:01:40 devstack cinder-volume[86851]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 03 08:01:40 devstack cinder-volume[86851]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89540
Nov 03 08:01:40 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Volume volume-e8478d74-b132-42bc-a4a3-a803f30449f7 (e8478d74-b132-42bc-a4a3-a803f30449f7): created successfully
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b924ff-a8d2-4c41-8cff-d8626919fc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Flow 'volume_create_manager' (6c099b77-5599-49fb-8a70-611d4041e55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0d999b-0736-46c2-8d0e-d3c89186d2d0]: (2,) {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:01:40 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-35f23289-576c-464c-b55b-f19c19afcf14 tempest-VolumesAdminNegativeTest-1773353681 None] Created volume successfully.
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ae10c-b78d-4bba-b5dc-1ce141671391]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:40 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-fad3c641-c94a-4daf-9785-42ac15dbbaea req-5e891621-c46d-4cd0-8dc7-31880a9858f2 tempest-ServerActionsTestOtherA-1011024138 None] Terminate volume connection completed successfully.
Nov 03 08:01:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-fad3c641-c94a-4daf-9785-42ac15dbbaea req-5e891621-c46d-4cd0-8dc7-31880a9858f2 tempest-ServerActionsTestOtherA-1011024138 None] Deleting attachment 6827fa93-b627-4093-8b5f-4063ed77265d. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:01:40 devstack sudo[89563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd
Nov 03 08:01:40 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:41 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd" returned: 0 in 0.655s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:41 devstack sudo[89591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd
Nov 03 08:01:41 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:41 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Acquiring lock "cinder-e8478d74-b132-42bc-a4a3-a803f30449f7-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:01:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-05db5b79-40b5-439b-9c35-0a8e416e60dd" returned: 0 in 0.502s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Lock "cinder-quobyte-05db5b79-40b5-439b-9c35-0a8e416e60dd" released by "delete_volume" :: held 3.246s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Lock "cinder-e8478d74-b132-42bc-a4a3-a803f30449f7-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:01:42 devstack cinder-volume[86851]: WARNING cinder.quota [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:01:42 devstack cinder-volume[86851]: WARNING cinder.quota [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fad3c641-c94a-4daf-9785-42ac15dbbaea req-366f2e4b-d63b-4262-87a5-945703158794 tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fad3c641-c94a-4daf-9785-42ac15dbbaea req-366f2e4b-d63b-4262-87a5-945703158794 tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Acquiring lock "cinder-quobyte-e8478d74-b132-42bc-a4a3-a803f30449f7" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fad3c641-c94a-4daf-9785-42ac15dbbaea req-366f2e4b-d63b-4262-87a5-945703158794 tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Created reservations ['c3f65217-a5c8-4af0-b9c1-a43f0f20595a', '12bee589-eb35-4593-b637-45852155fd9a', '341df20e-c706-4289-8b66-f010d16a32ac', '2e22bef8-6c36-4446-a573-2f5fd5bcc0eb'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Lock "cinder-quobyte-e8478d74-b132-42bc-a4a3-a803f30449f7" acquired by "delete_volume" :: waited 0.036s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf451c04-6cd4-4f8c-916f-429c76587a9c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-fad3c641-c94a-4daf-9785-42ac15dbbaea req-366f2e4b-d63b-4262-87a5-945703158794 tempest-ServerActionsTestOtherA-1011024138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-8543c968-c2c9-4543-b194-9bbbb0f49604', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d30d3f2-94dd-4a3e-b3c7-a41375548b41', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:42 devstack sudo[89609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7
Nov 03 08:01:42 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:42 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-fad3c641-c94a-4daf-9785-42ac15dbbaea req-366f2e4b-d63b-4262-87a5-945703158794 tempest-ServerActionsTestOtherA-1011024138 None] attachment_update completed successfully.
Nov 03 08:01:42 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:01:42 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:42 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:42 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7" returned: 0 in 0.456s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.359s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:01:42 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Deleted volume successfully.
Nov 03 08:01:42 devstack sudo[89617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7
Nov 03 08:01:42 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ba69bd8-0c39-4c3e-9358-4ab4cc2c4288 tempest-TaggedAttachmentsTest-2023730401 None] Lock "cinder-05db5b79-40b5-439b-9c35-0a8e416e60dd-delete_volume" released by "delete_volume" :: held 4.262s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:01:43 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8478d74-b132-42bc-a4a3-a803f30449f7" returned: 0 in 0.314s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Lock "cinder-quobyte-e8478d74-b132-42bc-a4a3-a803f30449f7" released by "delete_volume" :: held 0.843s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Created reservations ['78b760fc-e663-4b41-aa2d-82fecd992b60', '7db36b40-7966-43d5-b538-44fc76023e94', 'f3b7f299-14a9-4e90-a76f-32187a69d4a5', '391af3a7-4815-4990-884f-38c235d2c2e3'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:43 devstack sudo[89632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:01:43 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:43 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.304s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:01:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Deleted volume successfully.
Nov 03 08:01:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c76f3f3-8248-45cc-9ed0-308bf10b553f tempest-VolumesAdminNegativeTest-1773353681 None] Lock "cinder-e8478d74-b132-42bc-a4a3-a803f30449f7-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:01:53 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=33,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:01:53 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=37,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:01:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Acquiring lock "cinder-d92af681-1b03-499f-a798-c027c4db9575-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:01:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Lock "cinder-d92af681-1b03-499f-a798-c027c4db9575-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:01:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Acquiring lock "cinder-quobyte-d92af681-1b03-499f-a798-c027c4db9575" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:01:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Lock "cinder-quobyte-d92af681-1b03-499f-a798-c027c4db9575" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:01:57 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e990193-f22f-4ed5-a773-3ae83ee8d3c4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:01:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:57 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575
Nov 03 08:01:57 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:58 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575" returned: 0 in 0.542s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:58 devstack sudo[90163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575
Nov 03 08:01:58 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:58 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d92af681-1b03-499f-a798-c027c4db9575" returned: 0 in 0.339s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Lock "cinder-quobyte-d92af681-1b03-499f-a798-c027c4db9575" released by "delete_volume" :: held 0.960s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Created reservations ['7794d6f6-263b-4903-923f-af856b56fd68', '6d743da0-7582-4e9e-ae52-50f4b8e1d198', '21950620-98d1-42d5-8aa1-a08022ab05bf', '62ca6e38-167e-43ef-a0a0-4aa4911b5e03'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:01:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:01:58 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:01:58 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:01:59 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Nov 03 08:01:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.324s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:01:59 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:01:59 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Deleted volume successfully.
Nov 03 08:01:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cb9bdb5c-6e90-458e-8c72-813133212416 tempest-AttachVolumeShelveTestJSON-1699128690 None] Lock "cinder-d92af681-1b03-499f-a798-c027c4db9575-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Flow 'volume_create_manager' (c2723215-3ee7-4452-b3ed-a9b8c5324ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff5963-ea9b-4fd3-90e9-2eafeffb50fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff5963-ea9b-4fd3-90e9-2eafeffb50fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-201495629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc02167-5855-49e6-a347-46e8dbc799e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d6247217c1c141f0970425898b5b0e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:02Z,use_quota=True,user_id='329190554f10434296ebb1ccc589f805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6edf260c-e373-453d-9bb5-82523c57b4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6edf260c-e373-453d-9bb5-82523c57b4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b6035e-a63a-4457-9b15-ac3f5a748aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b6035e-a63a-4457-9b15-ac3f5a748aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcc02167-5855-49e6-a347-46e8dbc799e3', 'volume_name': 'volume-dcc02167-5855-49e6-a347-46e8dbc799e3', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4417d71d-a927-4eba-b456-f30617d85c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4417d71d-a927-4eba-b456-f30617d85c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283cc410-1a61-4936-9406-74b554068f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:01 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Volume dcc02167-5855-49e6-a347-46e8dbc799e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcc02167-5855-49e6-a347-46e8dbc799e3', 'volume_size': 1}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-201495629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc02167-5855-49e6-a347-46e8dbc799e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d6247217c1c141f0970425898b5b0e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:02Z,use_quota=True,user_id='329190554f10434296ebb1ccc589f805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Creating volume dcc02167-5855-49e6-a347-46e8dbc799e3 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:02:01 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:02:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:01 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3 1073741824
Nov 03 08:02:01 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:02 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3 1073741824" returned: 0 in 0.508s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:02 devstack sudo[90207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3
Nov 03 08:02:02 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:02 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3" returned: 0 in 0.288s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:02:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283cc410-1a61-4936-9406-74b554068f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcc02167-5855-49e6-a347-46e8dbc799e3', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d5557d-4b52-4fa0-bd39-108e55302185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:02 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Volume volume-dcc02167-5855-49e6-a347-46e8dbc799e3 (dcc02167-5855-49e6-a347-46e8dbc799e3): created successfully
Nov 03 08:02:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d5557d-4b52-4fa0-bd39-108e55302185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Flow 'volume_create_manager' (c2723215-3ee7-4452-b3ed-a9b8c5324ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-e8a11abb-7898-4ff0-a185-eeeedb016f60 req-d3c65354-7615-4155-a81b-f3ffdfe244c9 tempest-VolumesGetTestJSON-1357628996 None] Created volume successfully.
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:03 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:02:03 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:03 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.233s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 8 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:02:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:02:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Acquiring lock "cinder-dcc02167-5855-49e6-a347-46e8dbc799e3-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:02:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Lock "cinder-dcc02167-5855-49e6-a347-46e8dbc799e3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:02:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Acquiring lock "cinder-quobyte-dcc02167-5855-49e6-a347-46e8dbc799e3" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:02:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Lock "cinder-quobyte-dcc02167-5855-49e6-a347-46e8dbc799e3" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:02:04 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[522fec0d-bea2-425e-90a3-373659718937]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:02:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:04 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3
Nov 03 08:02:04 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:04 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3" returned: 0 in 0.471s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:04 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3
Nov 03 08:02:04 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:05 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dcc02167-5855-49e6-a347-46e8dbc799e3" returned: 0 in 0.252s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Lock "cinder-quobyte-dcc02167-5855-49e6-a347-46e8dbc799e3" released by "delete_volume" :: held 0.771s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG cinder.quota [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Created reservations ['48b871be-b0a6-48e8-8ee1-a8ad792e2253', 'c8a543f9-085e-478d-9fa7-073305143ea3', '15f3993a-8435-4853-9daa-34719ca13514', '2d1d9865-c370-481b-8c1e-6f2686c1bdcf'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:05 devstack sudo[90248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:02:05 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:05 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.304s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG cinder.manager [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:02:05 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Deleted volume successfully.
Nov 03 08:02:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-73f9234d-a084-498d-b62e-ec24845759a7 req-38ab443c-0e10-40f4-9503-5956e4d1c5b6 tempest-VolumesGetTestJSON-1357628996 None] Lock "cinder-dcc02167-5855-49e6-a347-46e8dbc799e3-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Flow 'volume_create_manager' (059ae748-c260-425e-be55-bc47f31ff6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3b62b1-d944-42df-a5c5-418583c13ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3b62b1-d944-42df-a5c5-418583c13ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-190848548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d3b031-20e5-4893-bcf0-eba4263dc1d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddc8e835d52f434aa44e2b29f4a60d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:11Z,use_quota=True,user_id='e5a5269c5fc345eab713e39d9d2a7927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937c9e70-a734-4a1e-8064-d95377c9c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937c9e70-a734-4a1e-8064-d95377c9c898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93065611-59fb-4921-8857-97a24ea4988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93065611-59fb-4921-8857-97a24ea4988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d3b031-20e5-4893-bcf0-eba4263dc1d5', 'volume_name': 'volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558af0f0-1b90-4750-b857-558eba364fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558af0f0-1b90-4750-b857-558eba364fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f237b7-8245-489f-83cd-2910049539c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:11 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Volume c8d3b031-20e5-4893-bcf0-eba4263dc1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5', 'volume_size': 1}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-190848548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d3b031-20e5-4893-bcf0-eba4263dc1d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddc8e835d52f434aa44e2b29f4a60d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:11Z,use_quota=True,user_id='e5a5269c5fc345eab713e39d9d2a7927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Creating volume c8d3b031-20e5-4893-bcf0-eba4263dc1d5 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:02:11 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:11 devstack sudo[90255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5 1073741824
Nov 03 08:02:11 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:11 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5 1073741824" returned: 0 in 0.574s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:11 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5
Nov 03 08:02:11 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:12 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5" returned: 0 in 0.289s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:02:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f237b7-8245-489f-83cd-2910049539c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74984ff-b575-4d4a-93e2-d04be4151226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:12 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Volume volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5 (c8d3b031-20e5-4893-bcf0-eba4263dc1d5): created successfully
Nov 03 08:02:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74984ff-b575-4d4a-93e2-d04be4151226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Flow 'volume_create_manager' (059ae748-c260-425e-be55-bc47f31ff6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0fc61e4a-bc0a-4da0-b7ce-d2cf9d91c702 tempest-VolumesTestJSON-568594379 None] Created volume successfully.
Nov 03 08:02:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-c4423e4e-16a9-4b60-babb-49d4acda863f req-309219ba-23fc-4898-b600-49f53f97de74 tempest-ServerActionsTestOtherA-1011024138 None] Terminate volume connection completed successfully.
Nov 03 08:02:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-c4423e4e-16a9-4b60-babb-49d4acda863f req-309219ba-23fc-4898-b600-49f53f97de74 tempest-ServerActionsTestOtherA-1011024138 None] Deleting attachment 2d30d3f2-94dd-4a3e-b3c7-a41375548b41. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:02:13 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Flow 'volume_create_manager' (1cb235a2-f8df-4288-8023-a55194f44bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d96aa3-4d72-4077-b5b9-532e8b607f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d96aa3-4d72-4077-b5b9-532e8b607f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1836468086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243f7a66-6f34-4806-b24f-e79eb79863ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddc8e835d52f434aa44e2b29f4a60d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:14Z,use_quota=True,user_id='e5a5269c5fc345eab713e39d9d2a7927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caecff88-57b0-43f9-9178-1ac20a634b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caecff88-57b0-43f9-9178-1ac20a634b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc63e583-fb07-4b3f-86d8-beaffdbaa95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc63e583-fb07-4b3f-86d8-beaffdbaa95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243f7a66-6f34-4806-b24f-e79eb79863ce', 'volume_name': 'volume-243f7a66-6f34-4806-b24f-e79eb79863ce', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86211c8f-2adc-4ae4-825a-57c1e220748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86211c8f-2adc-4ae4-825a-57c1e220748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ee7e1a-3213-44f1-ba42-bffc2f9afdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:14 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Volume 243f7a66-6f34-4806-b24f-e79eb79863ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243f7a66-6f34-4806-b24f-e79eb79863ce', 'volume_size': 1}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1836468086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243f7a66-6f34-4806-b24f-e79eb79863ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddc8e835d52f434aa44e2b29f4a60d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:14Z,use_quota=True,user_id='e5a5269c5fc345eab713e39d9d2a7927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Creating volume 243f7a66-6f34-4806-b24f-e79eb79863ce {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:02:14 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:14 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce 1073741824
Nov 03 08:02:14 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:14 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce 1073741824" returned: 0 in 0.772s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:14 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce
Nov 03 08:02:14 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:15 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce" returned: 0 in 0.261s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:02:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ee7e1a-3213-44f1-ba42-bffc2f9afdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243f7a66-6f34-4806-b24f-e79eb79863ce', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b841f65-0b79-41e1-b250-0e24327a6e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:15 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Volume volume-243f7a66-6f34-4806-b24f-e79eb79863ce (243f7a66-6f34-4806-b24f-e79eb79863ce): created successfully
Nov 03 08:02:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b841f65-0b79-41e1-b250-0e24327a6e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Flow 'volume_create_manager' (1cb235a2-f8df-4288-8023-a55194f44bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:15 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-47463912-cdde-4abf-83a2-a9271a498fdb tempest-VolumesTestJSON-568594379 None] Created volume successfully.
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Flow 'volume_create_manager' (8e1d7c96-b0ec-44c2-936c-fbd526e1edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4f12c8-388b-45b5-8639-f6124c0dbfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4f12c8-388b-45b5-8639-f6124c0dbfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1434107941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee2ce72-79ac-4ee5-bc3d-847c8c3b1268,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddc8e835d52f434aa44e2b29f4a60d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:17Z,use_quota=True,user_id='e5a5269c5fc345eab713e39d9d2a7927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92222909-c536-4596-8ca2-1a3a38834002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92222909-c536-4596-8ca2-1a3a38834002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e79fd1-b7a4-439b-9c98-e5d4a4cb4603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e79fd1-b7a4-439b-9c98-e5d4a4cb4603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee2ce72-79ac-4ee5-bc3d-847c8c3b1268', 'volume_name': 'volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e813aec5-4fc5-4708-9ca1-db4c495f9e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e813aec5-4fc5-4708-9ca1-db4c495f9e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36216272-67d6-4048-817b-291527327143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:16 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Volume bee2ce72-79ac-4ee5-bc3d-847c8c3b1268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268', 'volume_size': 1}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1434107941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee2ce72-79ac-4ee5-bc3d-847c8c3b1268,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddc8e835d52f434aa44e2b29f4a60d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:17Z,use_quota=True,user_id='e5a5269c5fc345eab713e39d9d2a7927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Creating volume bee2ce72-79ac-4ee5-bc3d-847c8c3b1268 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:02:16 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:02:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:16 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268 1073741824
Nov 03 08:02:16 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:17 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268 1073741824" returned: 0 in 0.622s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:17 devstack sudo[90328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268
Nov 03 08:02:17 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:17 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268" returned: 0 in 0.292s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:02:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36216272-67d6-4048-817b-291527327143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a395371c-ba37-4c5b-9bab-36bb191dd2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:17 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Volume volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268 (bee2ce72-79ac-4ee5-bc3d-847c8c3b1268): created successfully
Nov 03 08:02:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a395371c-ba37-4c5b-9bab-36bb191dd2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Flow 'volume_create_manager' (8e1d7c96-b0ec-44c2-936c-fbd526e1edab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-95a355fb-8142-491e-9dd4-74c92601b046 tempest-VolumesTestJSON-568594379 None] Created volume successfully.
Nov 03 08:02:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Acquiring lock "cinder-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:02:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Lock "cinder-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:02:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Acquiring lock "cinder-quobyte-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:02:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Lock "cinder-quobyte-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:02:20 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f87e738-385f-4cc8-9d54-faf864df8df8]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:02:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:20 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268
Nov 03 08:02:20 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:20 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268" returned: 0 in 0.461s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:20 devstack sudo[90340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268
Nov 03 08:02:20 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:21 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268" returned: 0 in 0.287s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Lock "cinder-quobyte-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268" released by "delete_volume" :: held 0.808s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Created reservations ['08614922-77da-42c0-966e-4e6eaccc41bc', '8a00c95c-5bdb-4be7-a2c3-b925dcb1f5d3', '38daf83b-1d38-409d-937c-f78afa45e508', '8e9df895-d6c1-4431-80f2-133327b47a33'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:21 devstack sudo[90343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:02:21 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Acquiring lock "cinder-243f7a66-6f34-4806-b24f-e79eb79863ce-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Lock "cinder-243f7a66-6f34-4806-b24f-e79eb79863ce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Acquiring lock "cinder-quobyte-243f7a66-6f34-4806-b24f-e79eb79863ce" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Lock "cinder-quobyte-243f7a66-6f34-4806-b24f-e79eb79863ce" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de742ba-174a-4ce5-8a40-7474d907a1fa]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:21 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.422s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:02:21 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Deleted volume successfully.
Nov 03 08:02:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c0e3624d-b64b-4b3b-a8bf-fb5aa8e7706f tempest-VolumesTestJSON-568594379 None] Lock "cinder-bee2ce72-79ac-4ee5-bc3d-847c8c3b1268-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:02:21 devstack sudo[90346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce
Nov 03 08:02:21 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:22 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce" returned: 0 in 0.457s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:22 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce
Nov 03 08:02:22 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:22 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-243f7a66-6f34-4806-b24f-e79eb79863ce" returned: 0 in 0.376s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Lock "cinder-quobyte-243f7a66-6f34-4806-b24f-e79eb79863ce" released by "delete_volume" :: held 0.900s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Created reservations ['1b96a914-01d5-4dc9-9aa4-fc79613e5581', 'be2e002d-a714-4243-ae84-5909373f7777', '005c5b46-6aa3-4231-93e2-f6f4d425c331', '1d346496-f7c1-44f8-840a-7d82b91e7ef1'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:22 devstack sudo[90354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:02:22 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Acquiring lock "cinder-c8d3b031-20e5-4893-bcf0-eba4263dc1d5-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:02:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Lock "cinder-c8d3b031-20e5-4893-bcf0-eba4263dc1d5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Acquiring lock "cinder-quobyte-c8d3b031-20e5-4893-bcf0-eba4263dc1d5" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Lock "cinder-quobyte-c8d3b031-20e5-4893-bcf0-eba4263dc1d5" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[620bfab5-aac6-4d7c-a77a-f5a162473618]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:23 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.354s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:02:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Deleted volume successfully.
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29e90002-37c8-4c48-84cc-3130b06ebadb tempest-VolumesTestJSON-568594379 None] Lock "cinder-243f7a66-6f34-4806-b24f-e79eb79863ce-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:02:23 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5
Nov 03 08:02:23 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:23 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5" returned: 0 in 0.459s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:23 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5
Nov 03 08:02:23 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:23 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8d3b031-20e5-4893-bcf0-eba4263dc1d5" returned: 0 in 0.301s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Lock "cinder-quobyte-c8d3b031-20e5-4893-bcf0-eba4263dc1d5" released by "delete_volume" :: held 0.816s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:02:23 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Created reservations ['ccdc9cdd-7ba2-4ed5-82fd-6bafb3e16766', '581c5508-1bcd-4ff5-a4de-e72347c9ef9d', 'f0892dca-c9ab-4f4a-8244-5a7ea14e0c8a', '1c89f10f-a833-4ba2-abf9-79861559e156'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:02:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:24 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:02:24 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:24 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.346s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:24 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:02:24 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Deleted volume successfully.
Nov 03 08:02:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caca2351-d8a0-426f-a718-1eecd9dafdc6 tempest-VolumesTestJSON-568594379 None] Lock "cinder-c8d3b031-20e5-4893-bcf0-eba4263dc1d5-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:02:28 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:02:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Flow 'volume_create_manager' (40f89e63-04bb-49ba-84ce-5c11940eb003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5a096c-cfb3-4302-a3a8-ff4179955cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5a096c-cfb3-4302-a3a8-ff4179955cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-133674001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0e9dbf-977a-424c-b3a8-066272d0345d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee85a8ba267f4ce4a8c385401b89330e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:29Z,use_quota=True,user_id='8f55f1c66b3e485b9c0ca56b6619acef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7955609-fc0d-4dff-80c9-00339d5905b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7955609-fc0d-4dff-80c9-00339d5905b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9612274d-aa67-40df-8f4b-194290c3c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:28 devstack cinder-volume[86851]: DEBUG cinder.image.glance [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Creating Keystone auth plugin from conf {{(pid=86851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 08:02:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9612274d-aa67-40df-8f4b-194290c3c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a0e9dbf-977a-424c-b3a8-066272d0345d', 'volume_name': 'volume-5a0e9dbf-977a-424c-b3a8-066272d0345d', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f823290>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad45a930-68be-492d-bdc1-3a99f8a12dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad45a930-68be-492d-bdc1-3a99f8a12dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b07b43-442e-4e32-9c62-715ed9c5427a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:29 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Volume 5a0e9dbf-977a-424c-b3a8-066272d0345d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a0e9dbf-977a-424c-b3a8-066272d0345d', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f823290>}
Nov 03 08:02:29 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Trying to clone 5a0e9dbf-977a-424c-b3a8-066272d0345d from image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]). {{(pid=86851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 08:02:30 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 08:02:30 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 08:02:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fdbd1c-3176-46be-b706-288e29627162]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:02:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:30 devstack sudo[90436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD
Nov 03 08:02:30 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:30 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:30 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Temporary image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 is fetched for user 8f55f1c66b3e485b9c0ca56b6619acef. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3bc656-312f-4157-8a7c-1f928ce0570f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:31 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD
Nov 03 08:02:31 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:31 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-133674001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0e9dbf-977a-424c-b3a8-066272d0345d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee85a8ba267f4ce4a8c385401b89330e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:29Z,use_quota=True,user_id='8f55f1c66b3e485b9c0ca56b6619acef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Creating volume 5a0e9dbf-977a-424c-b3a8-066272d0345d {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:02:31 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:02:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:31 devstack sudo[90466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d 1073741824
Nov 03 08:02:31 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:32 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d 1073741824" returned: 0 in 0.638s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:32 devstack sudo[90484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d
Nov 03 08:02:32 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:32 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-072007d7-95b4-40bc-b915-e86e7fdc506e tempest-GroupsV320Test-1594367048 None] Group tempest-GroupsV320Test-Group-1084580727: creating
Nov 03 08:02:32 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d" returned: 0 in 0.349s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:02:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:32 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-072007d7-95b4-40bc-b915-e86e7fdc506e tempest-GroupsV320Test-1594367048 None] Group tempest-GroupsV320Test-Group-1084580727: created successfully
Nov 03 08:02:32 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Attempting download of 8b203cae-6577-47a3-bc8a-1235a08ecbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}])) to volume 5a0e9dbf-977a-424c-b3a8-066272d0345d. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 08:02:32 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-072007d7-95b4-40bc-b915-e86e7fdc506e tempest-GroupsV320Test-1594367048 None] Create group completed successfully.
Nov 03 08:02:32 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27e802c-41bc-44cb-8ce8-517329e83246]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:02:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_j8cwtvu1 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:33 devstack sudo[90487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_j8cwtvu1
Nov 03 08:02:33 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:33 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_j8cwtvu1" returned: 0 in 0.368s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_j8cwtvu1 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:33 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_j8cwtvu1
Nov 03 08:02:33 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:33 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_j8cwtvu1" returned: 1 in 0.390s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_j8cwtvu1' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:02:33 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8d5e9-e9d6-4b92-872a-0e1f799bc61f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:02:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:33 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD
Nov 03 08:02:33 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:34 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:34 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] 8b203cae-6577-47a3-bc8a-1235a08ecbe1 was qcow2, converting to qcow2 {{(pid=86851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 08:02:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:34 devstack sudo[90518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d
Nov 03 08:02:34 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:34 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-fcd60c41-c937-4b51-aed6-3865a8038adb tempest-GroupsV320Test-1594367048 None] Created reservations ['a0a35a72-6e29-418d-84c8-062c54da0d43'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:02:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fcd60c41-c937-4b51-aed6-3865a8038adb tempest-GroupsV320Test-1594367048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fcd60c41-c937-4b51-aed6-3865a8038adb tempest-GroupsV320Test-1594367048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fcd60c41-c937-4b51-aed6-3865a8038adb tempest-GroupsV320Test-1594367048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fcd60c41-c937-4b51-aed6-3865a8038adb tempest-GroupsV320Test-1594367048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fcd60c41-c937-4b51-aed6-3865a8038adb tempest-GroupsV320Test-1594367048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fcd60c41-c937-4b51-aed6-3865a8038adb tempest-GroupsV320Test-1594367048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:34 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:02:34 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:35 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fcd60c41-c937-4b51-aed6-3865a8038adb tempest-GroupsV320Test-1594367048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.543s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:35 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-fcd60c41-c937-4b51-aed6-3865a8038adb tempest-GroupsV320Test-1594367048 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:02:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-fcd60c41-c937-4b51-aed6-3865a8038adb tempest-GroupsV320Test-1594367048 None] Delete group completed successfully.
Nov 03 08:02:38 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d" returned: 0 in 3.981s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:38 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_bvyeyynodevstack@QuobyteHD, size 112.00 MB, duration 3.98 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:02:38 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Converted 112.00 MB image at 28.13 MB/s
Nov 03 08:02:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:38 devstack sudo[90644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d 1G
Nov 03 08:02:38 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:38 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d 1G" returned: 0 in 0.566s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:38 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Downloaded image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}])) to volume 5a0e9dbf-977a-424c-b3a8-066272d0345d successfully. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 08:02:38 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Temporary image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 for user 8f55f1c66b3e485b9c0ca56b6619acef is deleted. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 08:02:38 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Marking volume 5a0e9dbf-977a-424c-b3a8-066272d0345d as bootable. {{(pid=86851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 08:02:38 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Copying metadata from image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 to 5a0e9dbf-977a-424c-b3a8-066272d0345d. {{(pid=86851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 08:02:38 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Creating volume glance metadata for volume 5a0e9dbf-977a-424c-b3a8-066272d0345d backed by image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 08:02:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b07b43-442e-4e32-9c62-715ed9c5427a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0e9dbf-977a-424c-b3a8-066272d0345d', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f823290>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426d1c7c-39cf-400e-afab-b9c0739964cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:39 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Volume volume-5a0e9dbf-977a-424c-b3a8-066272d0345d (5a0e9dbf-977a-424c-b3a8-066272d0345d): created successfully
Nov 03 08:02:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426d1c7c-39cf-400e-afab-b9c0739964cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Flow 'volume_create_manager' (40f89e63-04bb-49ba-84ce-5c11940eb003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:39 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3a98f398-6aeb-419f-ad51-f6b251e1a66e tempest-ServerActionsTestOtherA-1011024138 None] Created volume successfully.
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Flow 'volume_create_manager' (34d0e7f6-b7a0-404c-b658-2b9bb4cad3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11220b7e-e446-4ae9-b488-3321eac5b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11220b7e-e446-4ae9-b488-3321eac5b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-932537454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d669b13-c217-49c2-bc8a-0ddc4dcbfa05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='209466787c20453e9cb5c1804a62e784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:42Z,use_quota=True,user_id='0a5896b91f2a4fdeb7557919d88069b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a260e3-8d5a-4194-b56e-6f70ade30e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a260e3-8d5a-4194-b56e-6f70ade30e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5498ee99-a94c-4592-9c4d-c92a4c6ade57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5498ee99-a94c-4592-9c4d-c92a4c6ade57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d669b13-c217-49c2-bc8a-0ddc4dcbfa05', 'volume_name': 'volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa4b4c9-3b83-4c6e-bcd3-dadddaa185c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa4b4c9-3b83-4c6e-bcd3-dadddaa185c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446f15fc-cc6c-4a79-9421-3778b455b350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:41 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Volume 7d669b13-c217-49c2-bc8a-0ddc4dcbfa05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05', 'volume_size': 1}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-932537454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d669b13-c217-49c2-bc8a-0ddc4dcbfa05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='209466787c20453e9cb5c1804a62e784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:02:42Z,use_quota=True,user_id='0a5896b91f2a4fdeb7557919d88069b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Creating volume 7d669b13-c217-49c2-bc8a-0ddc4dcbfa05 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:02:41 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:02:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:41 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05 1073741824
Nov 03 08:02:41 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:42 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05 1073741824" returned: 0 in 0.737s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:42 devstack sudo[90665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05
Nov 03 08:02:42 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:43 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05" returned: 0 in 0.459s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:02:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446f15fc-cc6c-4a79-9421-3778b455b350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e41042-21b6-4489-8590-f023f83081eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:02:43 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Volume volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05 (7d669b13-c217-49c2-bc8a-0ddc4dcbfa05): created successfully
Nov 03 08:02:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e41042-21b6-4489-8590-f023f83081eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:02:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Flow 'volume_create_manager' (34d0e7f6-b7a0-404c-b658-2b9bb4cad3a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:02:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-90f51dc1-58e1-430b-8011-cbff8732d0f6 tempest-DeleteServersTestJSON-1437145342 None] Created volume successfully.
Nov 03 08:02:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fe5ab0e5-2884-4cd1-bffb-22001f6d4483 req-aee0e053-475a-4a10-814b-d2d85f303443 tempest-DeleteServersTestJSON-1437145342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fe5ab0e5-2884-4cd1-bffb-22001f6d4483 req-aee0e053-475a-4a10-814b-d2d85f303443 tempest-DeleteServersTestJSON-1437145342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fe5ab0e5-2884-4cd1-bffb-22001f6d4483 req-aee0e053-475a-4a10-814b-d2d85f303443 tempest-DeleteServersTestJSON-1437145342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-fe5ab0e5-2884-4cd1-bffb-22001f6d4483 req-aee0e053-475a-4a10-814b-d2d85f303443 tempest-DeleteServersTestJSON-1437145342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b87b5265-d9b6-479d-aa6d-0590b73d3227', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:02:45 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-fe5ab0e5-2884-4cd1-bffb-22001f6d4483 req-aee0e053-475a-4a10-814b-d2d85f303443 tempest-DeleteServersTestJSON-1437145342 None] attachment_update completed successfully.
Nov 03 08:02:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-c95d403e-0099-42a2-9e91-c92eebb167b7 req-8daa0ca7-88f0-4541-b526-939e1f645f99 tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-c95d403e-0099-42a2-9e91-c92eebb167b7 req-8daa0ca7-88f0-4541-b526-939e1f645f99 tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-c95d403e-0099-42a2-9e91-c92eebb167b7 req-8daa0ca7-88f0-4541-b526-939e1f645f99 tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-c95d403e-0099-42a2-9e91-c92eebb167b7 req-8daa0ca7-88f0-4541-b526-939e1f645f99 tempest-ServerActionsTestOtherA-1011024138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-5a0e9dbf-977a-424c-b3a8-066272d0345d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6390e9f-82a8-4f7b-8217-27f054963245', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:02:46 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-c95d403e-0099-42a2-9e91-c92eebb167b7 req-8daa0ca7-88f0-4541-b526-939e1f645f99 tempest-ServerActionsTestOtherA-1011024138 None] attachment_update completed successfully.
Nov 03 08:02:51 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-edb1e213-d771-4f25-b428-33f25b056a8e req-60c4607a-a100-4428-b078-519a1541e0ac tempest-DeleteServersTestJSON-1437145342 None] Terminate volume connection completed successfully.
Nov 03 08:02:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-edb1e213-d771-4f25-b428-33f25b056a8e req-60c4607a-a100-4428-b078-519a1541e0ac tempest-DeleteServersTestJSON-1437145342 None] Deleting attachment b87b5265-d9b6-479d-aa6d-0590b73d3227. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:02:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Acquiring lock "cinder-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:02:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Lock "cinder-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:02:54 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=65,cinder:INSERT=19,cinder:UPDATE=63,cinder:DELETE=4 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:02:54 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=70,cinder:SELECT=68,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:02:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Acquiring lock "cinder-quobyte-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:02:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Lock "cinder-quobyte-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:02:54 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b628d2-e588-4f18-a729-e216dfe0814d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:02:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:54 devstack sudo[91639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05
Nov 03 08:02:54 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:54 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05" returned: 0 in 0.433s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:54 devstack sudo[91645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05
Nov 03 08:02:54 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:55 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05" returned: 0 in 0.271s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Lock "cinder-quobyte-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05" released by "delete_volume" :: held 0.797s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Created reservations ['b8a88512-3f18-418c-92c1-017e002bd0b7', '173ae3ff-f75f-435d-840a-6411b3069482', '7594e665-dffc-4adc-9595-8e9e920597a5', 'a7ac7e7b-7d85-43fa-9e4b-ae283a97ce4a'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:02:55 devstack sudo[91648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:02:55 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:02:55 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.383s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:02:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Deleted volume successfully.
Nov 03 08:02:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7ac36ea5-a00a-4315-9cc9-76916628b979 tempest-DeleteServersTestJSON-1437145342 None] Lock "cinder-7d669b13-c217-49c2-bc8a-0ddc4dcbfa05-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:03:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:03:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:03:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:03:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:03 devstack sudo[91663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:03:03 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:03 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.430s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Flow 'volume_create_manager' (d8759d18-4f9e-4493-a13c-03a7927e92a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeeb8acc-a9a6-4a5a-9928-f138b52d9f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeeb8acc-a9a6-4a5a-9928-f138b52d9f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-945762092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1b215d-c220-49ec-bed4-d9bc72dfa81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e2c7b21a044939224bf525911ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:05Z,use_quota=True,user_id='2d23f11f8f5d478dac03532ba4924259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc003f0e-f217-4c91-8eda-e776385231a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc003f0e-f217-4c91-8eda-e776385231a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7064cde-7dc7-4979-8c10-2829ed5b548d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7064cde-7dc7-4979-8c10-2829ed5b548d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1b215d-c220-49ec-bed4-d9bc72dfa81a', 'volume_name': 'volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a171a41-fc86-4a68-a743-0239b10c46e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a171a41-fc86-4a68-a743-0239b10c46e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f084ef-825f-4093-840a-aaa561996434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:04 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Volume 6e1b215d-c220-49ec-bed4-d9bc72dfa81a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a', 'volume_size': 1}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-945762092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1b215d-c220-49ec-bed4-d9bc72dfa81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e2c7b21a044939224bf525911ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:05Z,use_quota=True,user_id='2d23f11f8f5d478dac03532ba4924259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Creating volume 6e1b215d-c220-49ec-bed4-d9bc72dfa81a {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:03:04 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:03:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:04 devstack sudo[91673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a 1073741824
Nov 03 08:03:04 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Flow 'volume_create_manager' (f4e862b4-fa61-45fd-9fb7-45cd4b2862ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb21767-5ef1-4b88-a52a-acca05f437ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb21767-5ef1-4b88-a52a-acca05f437ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-314163236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b84ac9-4781-4c31-8de1-38e1d3171457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f0427d79df43ccb469b267044433ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:06Z,use_quota=True,user_id='8e33d7549e1d48ceb877f70b34f8f7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48c3f0d-468e-44f4-b357-9a895bfdc2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48c3f0d-468e-44f4-b357-9a895bfdc2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceded396-cceb-4527-bcd9-d8a07b783551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceded396-cceb-4527-bcd9-d8a07b783551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b84ac9-4781-4c31-8de1-38e1d3171457', 'volume_name': 'volume-a5b84ac9-4781-4c31-8de1-38e1d3171457', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a9afa0-95da-4ad1-ae1b-120a6c792034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a9afa0-95da-4ad1-ae1b-120a6c792034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e7fa5e-6703-4a8b-b804-ecb1f80dc74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Volume a5b84ac9-4781-4c31-8de1-38e1d3171457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b84ac9-4781-4c31-8de1-38e1d3171457', 'volume_size': 1}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:05 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a 1073741824" returned: 0 in 1.032s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:05 devstack sudo[91679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a
Nov 03 08:03:05 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:06 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a" returned: 0 in 0.395s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-314163236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b84ac9-4781-4c31-8de1-38e1d3171457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f0427d79df43ccb469b267044433ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:06Z,use_quota=True,user_id='8e33d7549e1d48ceb877f70b34f8f7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Creating volume a5b84ac9-4781-4c31-8de1-38e1d3171457 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:03:06 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f084ef-825f-4093-840a-aaa561996434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:06 devstack sudo[91683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457 1073741824
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35ce53e-b763-4250-80c6-18dc64598589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:06 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:06 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Volume volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a (6e1b215d-c220-49ec-bed4-d9bc72dfa81a): created successfully
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35ce53e-b763-4250-80c6-18dc64598589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Flow 'volume_create_manager' (d8759d18-4f9e-4493-a13c-03a7927e92a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-77cf9f19-6f29-4ac4-ae16-26fc58eee2d7 tempest-AttachVolumeTestJSON-833307314 None] Created volume successfully.
Nov 03 08:03:07 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457 1073741824" returned: 0 in 0.638s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:07 devstack sudo[91693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457
Nov 03 08:03:07 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:07 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457" returned: 0 in 0.354s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:03:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e7fa5e-6703-4a8b-b804-ecb1f80dc74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b84ac9-4781-4c31-8de1-38e1d3171457', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53731ba8-6ab1-43d8-aa90-989689ba64c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:07 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Volume volume-a5b84ac9-4781-4c31-8de1-38e1d3171457 (a5b84ac9-4781-4c31-8de1-38e1d3171457): created successfully
Nov 03 08:03:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53731ba8-6ab1-43d8-aa90-989689ba64c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Flow 'volume_create_manager' (f4e862b4-fa61-45fd-9fb7-45cd4b2862ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:07 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1854072a-ee7f-4bd2-ac65-c128942f838b tempest-VolumesServicesTestJSON-2081818198 None] Created volume successfully.
Nov 03 08:03:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-7ac26a56-a8d2-4d58-ae83-7c245f3693be req-eaac282e-dd37-443f-8d5c-f7686f05d746 tempest-ServerActionsTestOtherA-1011024138 None] Terminate volume connection completed successfully.
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-7ac26a56-a8d2-4d58-ae83-7c245f3693be req-eaac282e-dd37-443f-8d5c-f7686f05d746 tempest-ServerActionsTestOtherA-1011024138 None] Deleting attachment c6390e9f-82a8-4f7b-8217-27f054963245. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-aff67942-1e06-4a74-a517-905bbcc1d980 req-b62e05a8-8946-4dbc-87d0-83452e4cb0cc tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-aff67942-1e06-4a74-a517-905bbcc1d980 req-b62e05a8-8946-4dbc-87d0-83452e4cb0cc tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-aff67942-1e06-4a74-a517-905bbcc1d980 req-b62e05a8-8946-4dbc-87d0-83452e4cb0cc tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-aff67942-1e06-4a74-a517-905bbcc1d980 req-b62e05a8-8946-4dbc-87d0-83452e4cb0cc tempest-AttachVolumeTestJSON-833307314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ceaafda3-7d4a-4e6a-8664-4686a6d3e753', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:03:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-aff67942-1e06-4a74-a517-905bbcc1d980 req-b62e05a8-8946-4dbc-87d0-83452e4cb0cc tempest-AttachVolumeTestJSON-833307314 None] attachment_update completed successfully.
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Acquiring lock "cinder-a5b84ac9-4781-4c31-8de1-38e1d3171457-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Lock "cinder-a5b84ac9-4781-4c31-8de1-38e1d3171457-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Acquiring lock "cinder-quobyte-a5b84ac9-4781-4c31-8de1-38e1d3171457" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Lock "cinder-quobyte-a5b84ac9-4781-4c31-8de1-38e1d3171457" acquired by "delete_volume" :: waited 0.036s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[216dd47d-2aeb-474b-b54c-47d88afd651c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:03:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:08 devstack sudo[91829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457
Nov 03 08:03:08 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:09 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457" returned: 0 in 0.601s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:09 devstack sudo[92174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457
Nov 03 08:03:09 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:09 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5b84ac9-4781-4c31-8de1-38e1d3171457" returned: 0 in 0.421s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Lock "cinder-quobyte-a5b84ac9-4781-4c31-8de1-38e1d3171457" released by "delete_volume" :: held 1.123s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Created reservations ['eeeea76a-a8dc-4d0c-851a-afe7e326f6c3', '9549e9b7-fd46-43ac-85be-4c79126a79f1', '968ff457-2dc0-4e5a-b537-1fc646ff3024', 'a45ae854-c8b7-4d4a-806a-763650323030'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:10 devstack sudo[92177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:03:10 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:10 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.398s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:10 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:03:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Deleted volume successfully.
Nov 03 08:03:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-64e35d89-c4da-430b-af02-b1c762716a90 tempest-VolumesServicesTestJSON-2081818198 None] Lock "cinder-a5b84ac9-4781-4c31-8de1-38e1d3171457-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:03:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-7ac26a56-a8d2-4d58-ae83-7c245f3693be req-ad15d7f7-1b59-4ee1-8510-a97829aa728d tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-7ac26a56-a8d2-4d58-ae83-7c245f3693be req-ad15d7f7-1b59-4ee1-8510-a97829aa728d tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-7ac26a56-a8d2-4d58-ae83-7c245f3693be req-ad15d7f7-1b59-4ee1-8510-a97829aa728d tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-7ac26a56-a8d2-4d58-ae83-7c245f3693be req-ad15d7f7-1b59-4ee1-8510-a97829aa728d tempest-ServerActionsTestOtherA-1011024138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-5a0e9dbf-977a-424c-b3a8-066272d0345d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57c471aa-e615-4dfd-85ad-668923f7e5c1', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:03:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-7ac26a56-a8d2-4d58-ae83-7c245f3693be req-ad15d7f7-1b59-4ee1-8510-a97829aa728d tempest-ServerActionsTestOtherA-1011024138 None] attachment_update completed successfully.
Nov 03 08:03:20 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=25,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=4 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:03:28 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=31,cinder:INSERT=5,cinder:UPDATE=32 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Flow 'volume_create_manager' (889f512d-4361-4d81-951b-e3e8769be2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa98d73b-1a39-4251-8ffb-0c3f0d0261c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa98d73b-1a39-4251-8ffb-0c3f0d0261c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1787255426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3d67e2-2f37-46d6-b24d-8559ecdd5f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454b253323b144d4b49c3f302d312e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:34Z,use_quota=True,user_id='1c4608d9e33d4566ae9ed009705a8da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5266b314-0b61-45fa-92b6-e9d695e648a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5266b314-0b61-45fa-92b6-e9d695e648a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92189521-e0c7-4e43-9722-1e35a33046e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.image.glance [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Creating Keystone auth plugin from conf {{(pid=86851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92189521-e0c7-4e43-9722-1e35a33046e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de3d67e2-2f37-46d6-b24d-8559ecdd5f9a', 'volume_name': 'volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f8cc0b0>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5dd8c0c-1547-48ec-8cfa-75d2cf80d147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5dd8c0c-1547-48ec-8cfa-75d2cf80d147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9da8b2-fb70-431b-b79e-7a1c0523cf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:34 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Volume de3d67e2-2f37-46d6-b24d-8559ecdd5f9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f8cc0b0>}
Nov 03 08:03:34 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Trying to clone de3d67e2-2f37-46d6-b24d-8559ecdd5f9a from image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]). {{(pid=86851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 08:03:35 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 08:03:35 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 08:03:35 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e567ed-6ea3-4f83-ab13-bfc1762d2a98]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:03:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:35 devstack sudo[92529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD
Nov 03 08:03:35 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:36 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD" returned: 0 in 0.629s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Temporary image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 is fetched for user 1c4608d9e33d4566ae9ed009705a8da3. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bb4675-d418-4eed-aa09-28a9bac6d99f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:36 devstack sudo[92550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD
Nov 03 08:03:36 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:36 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1787255426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3d67e2-2f37-46d6-b24d-8559ecdd5f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454b253323b144d4b49c3f302d312e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:34Z,use_quota=True,user_id='1c4608d9e33d4566ae9ed009705a8da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Creating volume de3d67e2-2f37-46d6-b24d-8559ecdd5f9a {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:03:36 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:03:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:36 devstack sudo[92558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a 1073741824
Nov 03 08:03:36 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:37 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a 1073741824" returned: 0 in 0.481s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:37 devstack sudo[92564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a
Nov 03 08:03:37 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:37 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a" returned: 0 in 0.286s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:03:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:37 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Attempting download of 8b203cae-6577-47a3-bc8a-1235a08ecbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}])) to volume de3d67e2-2f37-46d6-b24d-8559ecdd5f9a. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 08:03:37 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[846d972b-ab67-4194-b6a8-3e254fd1fec1]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:03:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_urs8sy8c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:37 devstack sudo[92567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_urs8sy8c
Nov 03 08:03:37 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:37 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_urs8sy8c" returned: 0 in 0.347s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_urs8sy8c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:38 devstack sudo[92571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_urs8sy8c
Nov 03 08:03:38 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:38 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_urs8sy8c" returned: 1 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_urs8sy8c' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:03:38 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e509c022-122a-43a5-a87f-088f24c2158b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:03:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:38 devstack sudo[92576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD
Nov 03 08:03:38 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:38 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:38 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] 8b203cae-6577-47a3-bc8a-1235a08ecbe1 was qcow2, converting to qcow2 {{(pid=86851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 08:03:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:38 devstack sudo[92585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a
Nov 03 08:03:38 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:41 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a" returned: 0 in 2.904s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:41 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_e_xfsltudevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:03:41 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Converted 112.00 MB image at 38.55 MB/s
Nov 03 08:03:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:41 devstack sudo[92613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a 1G
Nov 03 08:03:41 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:42 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a 1G" returned: 0 in 0.462s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:42 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Downloaded image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}])) to volume de3d67e2-2f37-46d6-b24d-8559ecdd5f9a successfully. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 08:03:42 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Temporary image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 for user 1c4608d9e33d4566ae9ed009705a8da3 is deleted. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 08:03:42 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Marking volume de3d67e2-2f37-46d6-b24d-8559ecdd5f9a as bootable. {{(pid=86851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 08:03:42 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Copying metadata from image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 to de3d67e2-2f37-46d6-b24d-8559ecdd5f9a. {{(pid=86851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 08:03:42 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Creating volume glance metadata for volume de3d67e2-2f37-46d6-b24d-8559ecdd5f9a backed by image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 08:03:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9da8b2-fb70-431b-b79e-7a1c0523cf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f8cc0b0>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2a09fd-85bc-430b-b057-c0a979c4c520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:42 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Volume volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a (de3d67e2-2f37-46d6-b24d-8559ecdd5f9a): created successfully
Nov 03 08:03:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2a09fd-85bc-430b-b057-c0a979c4c520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Flow 'volume_create_manager' (889f512d-4361-4d81-951b-e3e8769be2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:42 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e863502e-b2cf-4f75-9339-71cec12dd51f tempest-VolumesImageMetadata-1625201045 None] Created volume successfully.
Nov 03 08:03:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Acquiring lock "cinder-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:03:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Lock "cinder-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:03:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Acquiring lock "cinder-quobyte-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:03:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Lock "cinder-quobyte-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a" acquired by "delete_volume" :: waited 0.048s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:03:44 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b6f464-709a-492d-a4c3-a12e470f65ee]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:03:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:44 devstack sudo[92671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a
Nov 03 08:03:44 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:45 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a" returned: 0 in 1.178s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:45 devstack sudo[92692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a
Nov 03 08:03:45 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:46 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a" returned: 0 in 0.741s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Lock "cinder-quobyte-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a" released by "delete_volume" :: held 2.070s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:03:46 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Created reservations ['75d3fe20-4f0a-490f-9978-7761efed871c', '64d405aa-a3cb-4656-80a5-f1a80cc826bc', '4e3c36ff-a532-4a0e-9877-dd31fd4b9f92', '8b3bf800-523a-4129-b184-4625a6fce887'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:03:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:03:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:03:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:47 devstack sudo[92707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:03:47 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:47 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.592s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:47 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:03:47 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Deleted volume successfully.
Nov 03 08:03:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-26bc56d8-fe8b-41b3-8d53-f758c63eb0c8 tempest-VolumesImageMetadata-1625201045 None] Lock "cinder-de3d67e2-2f37-46d6-b24d-8559ecdd5f9a-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:03:49 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-b6dad9b8-4637-4c79-8a6d-b721d00339c7 tempest-ServerActionsTestOtherA-1011024138 None] Terminate volume connection completed successfully.
Nov 03 08:03:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-b6dad9b8-4637-4c79-8a6d-b721d00339c7 tempest-ServerActionsTestOtherA-1011024138 None] Deleting attachment 57c471aa-e615-4dfd-85ad-668923f7e5c1. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:03:49 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-30cd8730-8025-4310-aef8-659687d2ae95 req-07a2c79f-34f5-451f-bda8-bf764eba326f tempest-AttachVolumeTestJSON-833307314 None] Terminate volume connection completed successfully.
Nov 03 08:03:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-30cd8730-8025-4310-aef8-659687d2ae95 req-07a2c79f-34f5-451f-bda8-bf764eba326f tempest-AttachVolumeTestJSON-833307314 None] Deleting attachment ceaafda3-7d4a-4e6a-8664-4686a6d3e753. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:03:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "cinder-5a0e9dbf-977a-424c-b3a8-066272d0345d-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:03:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Lock "cinder-5a0e9dbf-977a-424c-b3a8-066272d0345d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:03:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "cinder-quobyte-5a0e9dbf-977a-424c-b3a8-066272d0345d" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:03:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Lock "cinder-quobyte-5a0e9dbf-977a-424c-b3a8-066272d0345d" acquired by "delete_volume" :: waited 0.053s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:03:50 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[77279fc1-3720-459d-a1ce-3b64e3df7461]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:03:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:50 devstack sudo[92766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d
Nov 03 08:03:50 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:50 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d" returned: 0 in 0.661s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:50 devstack sudo[92779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d
Nov 03 08:03:50 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:51 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5a0e9dbf-977a-424c-b3a8-066272d0345d" returned: 0 in 0.389s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Lock "cinder-quobyte-5a0e9dbf-977a-424c-b3a8-066272d0345d" released by "delete_volume" :: held 1.203s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG cinder.quota [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Created reservations ['e5fe9d4f-b13e-47ff-96fb-e8d2a7d7c054', '1478cfc6-6234-4e0a-a54b-d80317b9d48e', '3c9540ff-07ef-4cc3-92f5-d2d620e0418c', 'ece5a12a-df4c-4c15-91ea-a189793dfe7c'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:51 devstack sudo[92784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:03:51 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:51 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.310s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG cinder.manager [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:03:51 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Deleted volume successfully.
Nov 03 08:03:51 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-158b62a9-7730-4c4a-bc9d-74a92e4e9dd1 req-017a2e55-c205-490c-8dd0-fe8b2ac446ec tempest-ServerActionsTestOtherA-1011024138 None] Lock "cinder-5a0e9dbf-977a-424c-b3a8-066272d0345d-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:03:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "cinder-8543c968-c2c9-4543-b194-9bbbb0f49604-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:03:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Lock "cinder-8543c968-c2c9-4543-b194-9bbbb0f49604-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:03:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "cinder-quobyte-8543c968-c2c9-4543-b194-9bbbb0f49604" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:03:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Lock "cinder-quobyte-8543c968-c2c9-4543-b194-9bbbb0f49604" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:03:52 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceb2924-1c58-466c-8300-333123485549]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:03:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:52 devstack sudo[92787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604
Nov 03 08:03:52 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:52 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604" returned: 0 in 0.417s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:52 devstack sudo[92792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604
Nov 03 08:03:52 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:53 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8543c968-c2c9-4543-b194-9bbbb0f49604" returned: 0 in 0.406s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Lock "cinder-quobyte-8543c968-c2c9-4543-b194-9bbbb0f49604" released by "delete_volume" :: held 0.889s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Created reservations ['4eca9f91-3a1c-4da2-bb2f-2e4ddae54f24', '167066f8-1992-4deb-a9b2-c000e5814ff4', 'def72f29-efb0-4957-99af-c96ff4a6b264', 'a4f85609-56a6-438e-af7c-08e7ba4e7939'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:53 devstack sudo[92797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:03:53 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Flow 'volume_create_manager' (e511e231-51ea-4385-9ffb-1bb15a236258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831cb113-4f8f-42bb-9206-6cf49c502630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831cb113-4f8f-42bb-9206-6cf49c502630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1727834212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd3da79-fb8c-4bbc-8f13-d16e73fe5942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d653c816d44c5c90d3c2e6e6d9013b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:54Z,use_quota=True,user_id='ac015abc497c49bda69ed0bb89a9f414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ad240e-93cb-4e79-9f30-61db1b931e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ad240e-93cb-4e79-9f30-61db1b931e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e57c53-7c98-44f7-8c9a-d6a72daaa8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e57c53-7c98-44f7-8c9a-d6a72daaa8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd3da79-fb8c-4bbc-8f13-d16e73fe5942', 'volume_name': 'volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:53 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e80406-6b48-46f4-8bd4-67d31105983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e80406-6b48-46f4-8bd4-67d31105983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f701463-2976-495f-81ba-89f5c0913615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:53 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Volume 9cd3da79-fb8c-4bbc-8f13-d16e73fe5942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942', 'volume_size': 1}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1727834212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd3da79-fb8c-4bbc-8f13-d16e73fe5942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d653c816d44c5c90d3c2e6e6d9013b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:54Z,use_quota=True,user_id='ac015abc497c49bda69ed0bb89a9f414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Creating volume 9cd3da79-fb8c-4bbc-8f13-d16e73fe5942 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:03:53 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.489s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:03:53 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Deleted volume successfully.
Nov 03 08:03:53 devstack sudo[92803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942 1073741824
Nov 03 08:03:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1b145673-099f-49ba-8c48-bd60dbcbf50e tempest-ServerActionsTestOtherA-1011024138 None] Lock "cinder-8543c968-c2c9-4543-b194-9bbbb0f49604-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:03:53 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:54 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942 1073741824" returned: 0 in 1.045s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:54 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Flow 'volume_create_manager' (2a23e78e-6a0b-4806-8315-a5b41da60151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af11ba7-6f50-4fb6-8c6c-e9cd315311c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af11ba7-6f50-4fb6-8c6c-e9cd315311c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-894596392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d1f085-73a5-48f3-92e2-9786dde4421a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2c2a6a71b84e8886a73c241eac4d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:55Z,use_quota=True,user_id='dfef053fd28540cc91f1d9b7054157a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0567d192-56d2-464d-aa55-2f800cb0c6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0567d192-56d2-464d-aa55-2f800cb0c6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85407690-f3b2-4b17-9050-acad6424f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85407690-f3b2-4b17-9050-acad6424f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d1f085-73a5-48f3-92e2-9786dde4421a', 'volume_name': 'volume-74d1f085-73a5-48f3-92e2-9786dde4421a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6999f48e-fdcd-434d-a298-40eb5e5fa02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6999f48e-fdcd-434d-a298-40eb5e5fa02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a694e4ad-2f9e-4452-b4c6-fe9e336fdc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:55 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Volume 74d1f085-73a5-48f3-92e2-9786dde4421a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d1f085-73a5-48f3-92e2-9786dde4421a', 'volume_size': 1}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:55 devstack sudo[92856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942
Nov 03 08:03:55 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:55 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942" returned: 0 in 0.352s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.364s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-894596392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d1f085-73a5-48f3-92e2-9786dde4421a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2c2a6a71b84e8886a73c241eac4d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:55Z,use_quota=True,user_id='dfef053fd28540cc91f1d9b7054157a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Creating volume 74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:03:55 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f701463-2976-495f-81ba-89f5c0913615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee808720-739c-4aaa-83fb-74efbabbc304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:55 devstack sudo[92866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a 1073741824
Nov 03 08:03:55 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:55 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Volume volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942 (9cd3da79-fb8c-4bbc-8f13-d16e73fe5942): created successfully
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee808720-739c-4aaa-83fb-74efbabbc304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Flow 'volume_create_manager' (e511e231-51ea-4385-9ffb-1bb15a236258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-faac69de-7733-4a9f-80bd-d1b3b9e5b92c tempest-ServersNegativeTestJSON-745918618 None] Created volume successfully.
Nov 03 08:03:56 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a 1073741824" returned: 0 in 1.007s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:56 devstack sudo[92927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a
Nov 03 08:03:56 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:57 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a" returned: 0 in 0.525s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:03:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:03:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a694e4ad-2f9e-4452-b4c6-fe9e336fdc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d1f085-73a5-48f3-92e2-9786dde4421a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e5fe05-1a7a-43a3-a981-aab286c39a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:57 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Volume volume-74d1f085-73a5-48f3-92e2-9786dde4421a (74d1f085-73a5-48f3-92e2-9786dde4421a): created successfully
Nov 03 08:03:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e5fe05-1a7a-43a3-a981-aab286c39a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Flow 'volume_create_manager' (2a23e78e-6a0b-4806-8315-a5b41da60151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4f89ab98-8781-4520-b19a-731c86907ef7 tempest-VolumesDeleteCascade-1811852178 None] Created volume successfully.
Nov 03 08:03:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:03:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Creating offline snapshot a9fa8545-a48e-4191-9c5b-83016ec5dafe of volume 74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457c9a5-453a-4a69-a95c-9fe9d3ed9e12]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:59 devstack sudo[92945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a
Nov 03 08:03:59 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Flow 'volume_create_manager' (396aaa4a-a713-484b-9a79-8c579b659f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce55613-ffcd-40c3-8f91-953be1a305cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce55613-ffcd-40c3-8f91-953be1a305cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1942138736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa575c2-40f8-46d4-b1e9-3c4f06cb6841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d653c816d44c5c90d3c2e6e6d9013b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:59Z,use_quota=True,user_id='ac015abc497c49bda69ed0bb89a9f414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd35824-3bdf-45ee-b6e6-dcfc7239dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd35824-3bdf-45ee-b6e6-dcfc7239dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d40276-7611-4e89-915d-9cb80126b539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d40276-7611-4e89-915d-9cb80126b539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa575c2-40f8-46d4-b1e9-3c4f06cb6841', 'volume_name': 'volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a19e1c-f3cf-442e-ae6d-3180b8f5abec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a19e1c-f3cf-442e-ae6d-3180b8f5abec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ac515f-0e7a-4022-9ac0-22ab85454582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:03:59 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Volume 2aa575c2-40f8-46d4-b1e9-3c4f06cb6841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841', 'volume_size': 1}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:03:59 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a" returned: 0 in 0.524s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:03:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:03:59 devstack sudo[92951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe 1G
Nov 03 08:03:59 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:00 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe 1G" returned: 0 in 0.599s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d1f085-73a5-48f3-92e2-9786dde4421a -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:00 devstack sudo[92956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d1f085-73a5-48f3-92e2-9786dde4421a -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe
Nov 03 08:04:00 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:00 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d1f085-73a5-48f3-92e2-9786dde4421a -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe" returned: 0 in 0.356s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:00 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe is being set with open permissions: ugo+rw
Nov 03 08:04:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:00 devstack sudo[92961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe
Nov 03 08:04:00 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:00 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe" returned: 0 in 0.259s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:00 devstack sudo[92964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.info
Nov 03 08:04:00 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:01 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.info" returned: 0 in 0.274s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:01 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.info is being set with open permissions: ugo+rw
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:01 devstack sudo[92967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.info
Nov 03 08:04:01 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:01 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.info" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.998s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1942138736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa575c2-40f8-46d4-b1e9-3c4f06cb6841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d653c816d44c5c90d3c2e6e6d9013b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:03:59Z,use_quota=True,user_id='ac015abc497c49bda69ed0bb89a9f414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Creating volume 2aa575c2-40f8-46d4-b1e9-3c4f06cb6841 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:04:01 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:01 devstack sudo[92971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841 1073741824
Nov 03 08:04:01 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-83efa733-255e-45c9-b08f-ea8146f6572a tempest-VolumesDeleteCascade-1811852178 None] Create snapshot completed successfully
Nov 03 08:04:01 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841 1073741824" returned: 0 in 0.526s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:02 devstack sudo[92976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841
Nov 03 08:04:02 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:02 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841" returned: 0 in 0.440s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.027s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ac515f-0e7a-4022-9ac0-22ab85454582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6237b09f-d6ce-4a38-a717-a4e2e4feb9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] Creating offline snapshot f4e5ebd9-4b77-44c6-a34d-05b0f61a975d of volume 74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:04:02 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Volume volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841 (2aa575c2-40f8-46d4-b1e9-3c4f06cb6841): created successfully
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6237b09f-d6ce-4a38-a717-a4e2e4feb9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Flow 'volume_create_manager' (396aaa4a-a713-484b-9a79-8c579b659f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6dfda3-2845-4e3e-afbb-e13fcf07fd68]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-56bf3ee9-fccf-400c-a58a-16924cc73cec tempest-ServersNegativeTestJSON-745918618 None] Created volume successfully.
Nov 03 08:04:02 devstack sudo[92979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe
Nov 03 08:04:02 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:02 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe" returned: 0 in 0.458s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74d1f085-73a5-48f3-92e2-9786dde4421a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:04:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:03 devstack sudo[92984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d 1G
Nov 03 08:04:03 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:03 devstack sudo[92986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:04:03 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:03 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d 1G" returned: 0 in 0.503s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:03 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.339s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:04:03 devstack sudo[92994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d
Nov 03 08:04:03 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:03 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d" returned: 0 in 0.396s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:03 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d is being set with open permissions: ugo+rw
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:03 devstack sudo[92999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d
Nov 03 08:04:03 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Acquiring lock "cinder-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Lock "cinder-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Acquiring lock "cinder-quobyte-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Lock "cinder-quobyte-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[11588ad6-3280-46f8-91a1-ae90a8faedfa]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:04 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d" returned: 0 in 0.274s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.773s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:04 devstack sudo[93001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841
Nov 03 08:04:04 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:04 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1d7d6797-fd38-4371-a80f-9d7e37b1c662 tempest-VolumesDeleteCascade-1811852178 None] Create snapshot completed successfully
Nov 03 08:04:04 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841" returned: 0 in 0.437s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:04 devstack sudo[93007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841
Nov 03 08:04:04 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-74d1f085-73a5-48f3-92e2-9786dde4421a-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-74d1f085-73a5-48f3-92e2-9786dde4421a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Performing cascade delete. {{(pid=86851) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-a9fa8545-a48e-4191-9c5b-83016ec5dafe-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:04 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841" returned: 0 in 0.413s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-a9fa8545-a48e-4191-9c5b-83016ec5dafe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-74d1f085-73a5-48f3-92e2-9786dde4421a" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Lock "cinder-quobyte-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841" released by "delete_volume" :: held 0.913s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-74d1f085-73a5-48f3-92e2-9786dde4421a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-a9fa8545-a48e-4191-9c5b-83016ec5dafe" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-a9fa8545-a48e-4191-9c5b-83016ec5dafe" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Deleting offline snapshot a9fa8545-a48e-4191-9c5b-83016ec5dafe of volume 74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] snapshot_file for this snap is: volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecb7500-8efb-42cd-b6e1-a750adef0cab]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Created reservations ['03428e59-0ff9-400a-9800-9ddbc6c84630', '21f0bc57-366a-4396-9af3-16ac7e6f4da9', 'bab2d6e5-c83e-4f33-be98-aff54c79c18e', 'e2304e9d-38be-4a40-82b2-b5969469c0fd'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:05 devstack sudo[93011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:04:05 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:05 devstack sudo[93010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe
Nov 03 08:04:05 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:05 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.305s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:04:05 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Deleted volume successfully.
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-da994fc8-6e3c-4544-8f2d-bece1c46803f tempest-ServersNegativeTestJSON-745918618 None] Lock "cinder-2aa575c2-40f8-46d4-b1e9-3c4f06cb6841-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:05 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe" returned: 0 in 0.513s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74d1f085-73a5-48f3-92e2-9786dde4421a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[de37d6eb-70ee-45e9-9aad-35fbb7ad33ce]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:05 devstack sudo[93018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a
Nov 03 08:04:05 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:06 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a" returned: 0 in 0.479s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dbb8ab-5cc9-4b85-8f7f-0947267624a2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Acquiring lock "cinder-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Lock "cinder-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:06 devstack sudo[93024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d
Nov 03 08:04:06 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Acquiring lock "cinder-quobyte-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Lock "cinder-quobyte-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ff6e0b-cf98-4ae9-bf62-77a421b10ff0]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:06 devstack sudo[93026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942
Nov 03 08:04:06 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:06 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d" returned: 0 in 0.501s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74d1f085-73a5-48f3-92e2-9786dde4421a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bcd952-e1b4-4a39-be8f-2396680b655a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:06 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942" returned: 0 in 0.437s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:06 devstack sudo[93036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942
Nov 03 08:04:06 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:06 devstack sudo[93032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe
Nov 03 08:04:06 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:07 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942" returned: 0 in 0.285s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Lock "cinder-quobyte-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942" released by "delete_volume" :: held 0.779s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Created reservations ['58f84c6b-5f5d-47e8-8bae-6807ee2c24fc', '0f3d424c-5e7a-4013-ab57-0af70321e602', '4fde24cc-f7cf-436e-9dc1-5a0210b89ea9', 'dac47c14-bd9d-496e-bb15-7d694bd6a74f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:04:07 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe" returned: 0 in 0.607s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74d1f085-73a5-48f3-92e2-9786dde4421a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f016e-b925-49d5-b4ed-1e01bb9afa9a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:07 devstack sudo[93044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:04:07 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:07 devstack sudo[93045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a
Nov 03 08:04:07 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:07 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:04:07 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Deleted volume successfully.
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b0d7162-7d14-408e-a8d4-fd1e22d46fc7 tempest-ServersNegativeTestJSON-745918618 None] Lock "cinder-9cd3da79-fb8c-4bbc-8f13-d16e73fe5942-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:07 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a" returned: 0 in 0.550s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:07 devstack sudo[93054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe
Nov 03 08:04:07 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:08 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe" returned: 0 in 0.680s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:08 devstack sudo[93078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe
Nov 03 08:04:08 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:09 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.a9fa8545-a48e-4191-9c5b-83016ec5dafe" returned: 0 in 0.457s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d1f085-73a5-48f3-92e2-9786dde4421a /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d -F qcow2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:09 devstack sudo[93085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d1f085-73a5-48f3-92e2-9786dde4421a /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d -F qcow2
Nov 03 08:04:09 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:09 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d1f085-73a5-48f3-92e2-9786dde4421a /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d -F qcow2" returned: 0 in 0.596s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-a9fa8545-a48e-4191-9c5b-83016ec5dafe" released by "_delete_snapshot" :: held 4.734s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-74d1f085-73a5-48f3-92e2-9786dde4421a" released by "delete_snapshot" :: held 4.763s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:09 devstack cinder-volume[86851]: WARNING cinder.quota [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Created reservations ['99907c51-a59c-4b6b-8669-ec04a0fe40e3', '6dcb6007-7881-4528-8201-5c419eea4410', 'fb917c35-ef4d-4d63-a5b0-e5493e398060', '0e512668-477d-466d-acb1-3dfffa47d0b7'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:04:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Delete snapshot completed successfully.
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-a9fa8545-a48e-4191-9c5b-83016ec5dafe-delete_snapshot" released by "delete_snapshot" :: held 4.987s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-f4e5ebd9-4b77-44c6-a34d-05b0f61a975d-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-f4e5ebd9-4b77-44c6-a34d-05b0f61a975d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-74d1f085-73a5-48f3-92e2-9786dde4421a" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-74d1f085-73a5-48f3-92e2-9786dde4421a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-f4e5ebd9-4b77-44c6-a34d-05b0f61a975d" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-f4e5ebd9-4b77-44c6-a34d-05b0f61a975d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Deleting offline snapshot f4e5ebd9-4b77-44c6-a34d-05b0f61a975d of volume 74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:04:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] snapshot_file for this snap is: volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:04:10 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef17ed4-b40e-412b-8e07-7077bdc2593a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:10 devstack sudo[93092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d
Nov 03 08:04:10 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:10 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d" returned: 0 in 0.566s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74d1f085-73a5-48f3-92e2-9786dde4421a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:04:10 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[deea7fe9-f076-49bb-bc1e-13ced7e656d4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:10 devstack sudo[93097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a
Nov 03 08:04:10 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:11 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a" returned: 0 in 0.431s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:11 devstack sudo[93102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d
Nov 03 08:04:11 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:11 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d" returned: 0 in 0.469s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:11 devstack sudo[93107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d
Nov 03 08:04:11 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:11 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a.f4e5ebd9-4b77-44c6-a34d-05b0f61a975d" returned: 0 in 0.296s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-f4e5ebd9-4b77-44c6-a34d-05b0f61a975d" released by "_delete_snapshot" :: held 1.884s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-74d1f085-73a5-48f3-92e2-9786dde4421a" released by "delete_snapshot" :: held 1.918s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:11 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Created reservations ['81db0062-8aa7-4761-95c1-0b7291c616ae', 'aa03c4f9-3e28-4803-a2c3-92cfc2fa691d', 'a5f3c374-6b57-4d91-95cd-10fc27ae68aa', '5a563464-c41a-4a8e-9153-49842553e677'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:04:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Delete snapshot completed successfully.
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-f4e5ebd9-4b77-44c6-a34d-05b0f61a975d-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Snapshots deleted, issuing volume delete {{(pid=86851) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-74d1f085-73a5-48f3-92e2-9786dde4421a" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-74d1f085-73a5-48f3-92e2-9786dde4421a" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3efff9-c2ba-44f6-be34-9cd943ed51c2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:12 devstack sudo[93110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a
Nov 03 08:04:12 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:12 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a" returned: 0 in 0.479s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:12 devstack sudo[93115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a
Nov 03 08:04:12 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:12 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-74d1f085-73a5-48f3-92e2-9786dde4421a" returned: 0 in 0.261s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-74d1f085-73a5-48f3-92e2-9786dde4421a" released by "delete_volume" :: held 0.830s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:12 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Created reservations ['ea60f2e7-9777-4e06-8b91-4378f44a3178', 'f5da8315-5c15-40b1-a159-c1f089ffb844', '0b5c5543-075c-4105-a24c-ca42558ae98d', '0a1bdb62-a529-41e3-92ba-59501fe3e696'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:04:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:13 devstack sudo[93119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:04:13 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:13 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:13 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:04:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Deleted volume successfully.
Nov 03 08:04:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8982807f-5ce0-42c4-8296-62f229b76ac3 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-74d1f085-73a5-48f3-92e2-9786dde4421a-delete_volume" released by "delete_volume" :: held 8.560s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Flow 'volume_create_manager' (174775c0-68f5-46e9-b748-82ee045ea10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d24f888-9199-4642-a76a-53ca0d2c4b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d24f888-9199-4642-a76a-53ca0d2c4b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-75096393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45e8799-945e-4adc-9d8a-7b257efb9beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2c2a6a71b84e8886a73c241eac4d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:04:15Z,use_quota=True,user_id='dfef053fd28540cc91f1d9b7054157a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119aa1a6-9805-41a9-bacc-bb7e3d41443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119aa1a6-9805-41a9-bacc-bb7e3d41443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ced882-f260-49a3-ac9d-dcb49ade8f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ced882-f260-49a3-ac9d-dcb49ade8f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd45e8799-945e-4adc-9d8a-7b257efb9beb', 'volume_name': 'volume-d45e8799-945e-4adc-9d8a-7b257efb9beb', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99366e15-2fee-4165-ac52-bbe7362d0e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99366e15-2fee-4165-ac52-bbe7362d0e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af8168f-b96e-4d6e-a9bf-a2c0811fd477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:14 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Volume d45e8799-945e-4adc-9d8a-7b257efb9beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d45e8799-945e-4adc-9d8a-7b257efb9beb', 'volume_size': 1}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-75096393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45e8799-945e-4adc-9d8a-7b257efb9beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2c2a6a71b84e8886a73c241eac4d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:04:15Z,use_quota=True,user_id='dfef053fd28540cc91f1d9b7054157a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Creating volume d45e8799-945e-4adc-9d8a-7b257efb9beb {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:04:14 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:04:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:14 devstack sudo[93132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb 1073741824
Nov 03 08:04:14 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:15 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb 1073741824" returned: 0 in 0.655s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:15 devstack sudo[93139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb
Nov 03 08:04:15 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:15 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb" returned: 0 in 0.285s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:04:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af8168f-b96e-4d6e-a9bf-a2c0811fd477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d45e8799-945e-4adc-9d8a-7b257efb9beb', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85e9c5c-c479-4132-8e03-e4e2449cd6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:15 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Volume volume-d45e8799-945e-4adc-9d8a-7b257efb9beb (d45e8799-945e-4adc-9d8a-7b257efb9beb): created successfully
Nov 03 08:04:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85e9c5c-c479-4132-8e03-e4e2449cd6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Flow 'volume_create_manager' (174775c0-68f5-46e9-b748-82ee045ea10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:04:15 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-19107317-abe4-4dfe-acd5-06c78d0d5d98 tempest-VolumesDeleteCascade-1811852178 None] Created volume successfully.
Nov 03 08:04:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Creating offline snapshot d2930161-cae0-4019-b2b1-45c51b9baf09 of volume d45e8799-945e-4adc-9d8a-7b257efb9beb {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:04:17 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b94fd6c-d952-4907-8df3-e19be4e12e21]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:17 devstack sudo[93151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb
Nov 03 08:04:17 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:17 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb" returned: 0 in 0.456s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:17 devstack sudo[93156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 1G
Nov 03 08:04:17 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:18 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 1G" returned: 0 in 0.515s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d45e8799-945e-4adc-9d8a-7b257efb9beb -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:18 devstack sudo[93164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d45e8799-945e-4adc-9d8a-7b257efb9beb -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09
Nov 03 08:04:18 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:18 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d45e8799-945e-4adc-9d8a-7b257efb9beb -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09" returned: 0 in 0.342s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:18 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 is being set with open permissions: ugo+rw
Nov 03 08:04:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:18 devstack sudo[93170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09
Nov 03 08:04:18 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:18 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09" returned: 0 in 0.363s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:18 devstack sudo[93173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.info
Nov 03 08:04:18 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:19 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.info" returned: 0 in 0.313s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:19 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.info is being set with open permissions: ugo+rw
Nov 03 08:04:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:19 devstack sudo[93178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.info
Nov 03 08:04:19 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:19 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.info" returned: 0 in 0.336s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:19 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-39da4255-a1f6-4250-b7cb-8779c4be944b tempest-VolumesDeleteCascade-1811852178 None] Create snapshot completed successfully
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Flow 'volume_create_manager' (408d56c4-7964-4046-af51-b447819fcb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d93293-8bc3-405b-b2a6-031571062d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d93293-8bc3-405b-b2a6-031571062d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1556514055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdb810f-89ee-460b-9c39-c9e66261b351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2c2a6a71b84e8886a73c241eac4d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d2930161-cae0-4019-b2b1-45c51b9baf09,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:04:21Z,use_quota=True,user_id='dfef053fd28540cc91f1d9b7054157a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b558338-ff0c-418d-b5ac-bb5482f772e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b558338-ff0c-418d-b5ac-bb5482f772e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f552a664-ccf5-497d-a578-1106994f44c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f552a664-ccf5-497d-a578-1106994f44c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1fdb810f-89ee-460b-9c39-c9e66261b351', 'volume_name': 'volume-1fdb810f-89ee-460b-9c39-c9e66261b351', 'volume_size': 1, 'snapshot_id': 'd2930161-cae0-4019-b2b1-45c51b9baf09'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c74015-7063-4f99-9b42-ec3651bae2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c74015-7063-4f99-9b42-ec3651bae2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8744c6-2cda-4a2d-9f96-52fd686e113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:21 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Volume 1fdb810f-89ee-460b-9c39-c9e66261b351: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1fdb810f-89ee-460b-9c39-c9e66261b351', 'volume_size': 1, 'snapshot_id': 'd2930161-cae0-4019-b2b1-45c51b9baf09'}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-d2930161-cae0-4019-b2b1-45c51b9baf09-1fdb810f-89ee-460b-9c39-c9e66261b351" by "_create_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-d2930161-cae0-4019-b2b1-45c51b9baf09-1fdb810f-89ee-460b-9c39-c9e66261b351" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Creating volume 1fdb810f-89ee-460b-9c39-c9e66261b351 from snapshot d2930161-cae0-4019-b2b1-45c51b9baf09 {{(pid=86851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-1fdb810f-89ee-460b-9c39-c9e66261b351" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-1fdb810f-89ee-460b-9c39-c9e66261b351" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] snapshot: d2930161-cae0-4019-b2b1-45c51b9baf09, volume: 1fdb810f-89ee-460b-9c39-c9e66261b351,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[212ed9b0-352f-46ac-a9b2-e20b4cdf978b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:21 devstack sudo[93203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09
Nov 03 08:04:21 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c6a97a2c-cbe8-4a37-a3fd-0012cd7a1ef5 tempest-GroupSnapshotsTest-668021592 None] Group tempest-GroupSnapshotsTest-Group-818049914: creating
Nov 03 08:04:22 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09" returned: 0 in 0.563s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d45e8799-945e-4adc-9d8a-7b257efb9beb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:04:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c6a97a2c-cbe8-4a37-a3fd-0012cd7a1ef5 tempest-GroupSnapshotsTest-668021592 None] Group tempest-GroupSnapshotsTest-Group-818049914: created successfully
Nov 03 08:04:22 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8c5f2d-e41f-48d7-b88b-619e0234c556]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c6a97a2c-cbe8-4a37-a3fd-0012cd7a1ef5 tempest-GroupSnapshotsTest-668021592 None] Create group completed successfully.
Nov 03 08:04:22 devstack sudo[93210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb
Nov 03 08:04:22 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:22 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb" returned: 0 in 0.458s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:04:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:04:22 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351 not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:04:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:22 devstack sudo[93216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351
Nov 03 08:04:22 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Flow 'volume_create_manager' (2f41a889-aa2e-42cb-a6f3-855f64eb57e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded030b9-deeb-4ee2-b510-6d75dfb2b7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded030b9-deeb-4ee2-b510-6d75dfb2b7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-457645938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cbc05e45-28cf-4995-b96f-137664efdbdf,host='devstack@QuobyteHD#QuobyteHD',id=29d4b266-c957-4a73-9138-fab7544f9b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a9add118ca4d42b407e20591d3628b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:04:24Z,use_quota=True,user_id='9178a654037748238e5ad158a87a8691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a38342-1246-448f-9843-aefb23a5a59b),volume_type_id=76a38342-1246-448f-9843-aefb23a5a59b)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29a301f-7e1a-4d34-8144-f2a04e13ae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29a301f-7e1a-4d34-8144-f2a04e13ae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34dea9c4-c1ef-4546-aeda-058627a5e8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34dea9c4-c1ef-4546-aeda-058627a5e8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d4b266-c957-4a73-9138-fab7544f9b96', 'volume_name': 'volume-29d4b266-c957-4a73-9138-fab7544f9b96', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fe6f14-5b0d-4f3f-97cc-01f5ffbaf74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fe6f14-5b0d-4f3f-97cc-01f5ffbaf74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c28190-dc2c-4839-a198-03a2617bce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:24 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Volume 29d4b266-c957-4a73-9138-fab7544f9b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d4b266-c957-4a73-9138-fab7544f9b96', 'volume_size': 1}
Nov 03 08:04:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:32 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351" returned: 0 in 10.344s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:32 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb, size 1024.00 MB, duration 10.35 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:04:32 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Converted 1024.00 MB image at 98.98 MB/s
Nov 03 08:04:32 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351 is being set with open permissions: ugo+rw
Nov 03 08:04:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:32 devstack sudo[93315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351
Nov 03 08:04:32 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:33 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351" returned: 0 in 0.368s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-1fdb810f-89ee-460b-9c39-c9e66261b351" released by "_copy_volume_from_snapshot" :: held 11.856s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=75,cinder:UPDATE=83,cinder:INSERT=26,cinder:DELETE=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=74,cinder:UPDATE=81,cinder:INSERT=26,cinder:DELETE=12 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-d2930161-cae0-4019-b2b1-45c51b9baf09-1fdb810f-89ee-460b-9c39-c9e66261b351" released by "_create_volume_from_snapshot" :: held 11.951s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.971s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.760s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cbc05e45-28cf-4995-b96f-137664efdbdf,created_at=2026-11-03T07:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-457645938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cbc05e45-28cf-4995-b96f-137664efdbdf,host='devstack@QuobyteHD#QuobyteHD',id=29d4b266-c957-4a73-9138-fab7544f9b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a9add118ca4d42b407e20591d3628b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:04:24Z,use_quota=True,user_id='9178a654037748238e5ad158a87a8691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a38342-1246-448f-9843-aefb23a5a59b),volume_type_id=76a38342-1246-448f-9843-aefb23a5a59b)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Creating volume 29d4b266-c957-4a73-9138-fab7544f9b96 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:04:33 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:33 devstack sudo[93331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 1073741824
Nov 03 08:04:33 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8744c6-2cda-4a2d-9f96-52fd686e113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdb810f-89ee-460b-9c39-c9e66261b351', 'volume_size': 1, 'snapshot_id': 'd2930161-cae0-4019-b2b1-45c51b9baf09'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e442e6-dcbe-49c1-8524-b4cd7fbde69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:33 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Volume volume-1fdb810f-89ee-460b-9c39-c9e66261b351 (1fdb810f-89ee-460b-9c39-c9e66261b351): created successfully
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e442e6-dcbe-49c1-8524-b4cd7fbde69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Flow 'volume_create_manager' (408d56c4-7964-4046-af51-b447819fcb34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:04:33 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-16c52418-195d-4632-b5b7-91fd4dbec36d tempest-VolumesDeleteCascade-1811852178 None] Created volume successfully.
Nov 03 08:04:34 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 1073741824" returned: 0 in 0.706s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:34 devstack sudo[93342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96
Nov 03 08:04:34 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:34 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96" returned: 0 in 0.320s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c28190-dc2c-4839-a198-03a2617bce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d4b266-c957-4a73-9138-fab7544f9b96', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8669fce6-5897-4155-9a6a-737401969ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:04:34 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Volume volume-29d4b266-c957-4a73-9138-fab7544f9b96 (29d4b266-c957-4a73-9138-fab7544f9b96): created successfully
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8669fce6-5897-4155-9a6a-737401969ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Flow 'volume_create_manager' (2f41a889-aa2e-42cb-a6f3-855f64eb57e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:04:34 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d92b2483-6f89-4f0a-8e2c-70e50204b477 tempest-GroupSnapshotsTest-668021592 None] Created volume successfully.
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-d45e8799-945e-4adc-9d8a-7b257efb9beb-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-d45e8799-945e-4adc-9d8a-7b257efb9beb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Performing cascade delete. {{(pid=86851) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 03 08:04:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-d2930161-cae0-4019-b2b1-45c51b9baf09-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-d2930161-cae0-4019-b2b1-45c51b9baf09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-d45e8799-945e-4adc-9d8a-7b257efb9beb" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-d45e8799-945e-4adc-9d8a-7b257efb9beb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-d2930161-cae0-4019-b2b1-45c51b9baf09" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-d2930161-cae0-4019-b2b1-45c51b9baf09" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Deleting offline snapshot d2930161-cae0-4019-b2b1-45c51b9baf09 of volume d45e8799-945e-4adc-9d8a-7b257efb9beb {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] snapshot_file for this snap is: volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b787c-f9ac-4aee-bb03-a4202f23f266]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:35 devstack sudo[93346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09
Nov 03 08:04:35 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:35 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09" returned: 0 in 0.509s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d45e8799-945e-4adc-9d8a-7b257efb9beb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b6bec6-1883-4602-9cbb-c3a01d58509e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:35 devstack sudo[93359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb
Nov 03 08:04:35 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:36 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] GroupSnapshot bfc00ec7-a413-4d72-9bf5-22d7be5adc8d: creating.
Nov 03 08:04:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Group snapshot bfc00ec7-a413-4d72-9bf5-22d7be5adc8d: creating. {{(pid=86851) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 08:04:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Creating offline snapshot 7b3b5791-93cc-458a-b91f-cd5772f56e72 of volume 29d4b266-c957-4a73-9138-fab7544f9b96 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:04:36 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a97b4d-18be-4613-a3fe-d35d5dbc3223]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:36 devstack sudo[93390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96
Nov 03 08:04:36 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:36 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb" returned: 0 in 1.146s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:36 devstack sudo[93429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09
Nov 03 08:04:36 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:37 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96" returned: 0 in 0.894s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:37 devstack sudo[93441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 1G
Nov 03 08:04:37 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:37 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09" returned: 0 in 0.895s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:37 devstack sudo[93457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09
Nov 03 08:04:37 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:38 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb.d2930161-cae0-4019-b2b1-45c51b9baf09" returned: 0 in 0.411s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:38 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 1G" returned: 0 in 1.007s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d4b266-c957-4a73-9138-fab7544f9b96 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-d2930161-cae0-4019-b2b1-45c51b9baf09" released by "_delete_snapshot" :: held 3.261s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-d45e8799-945e-4adc-9d8a-7b257efb9beb" released by "delete_snapshot" :: held 3.318s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:38 devstack sudo[93467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d4b266-c957-4a73-9138-fab7544f9b96 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72
Nov 03 08:04:38 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Created reservations ['3cfb8f40-5fac-4769-b289-2afb15318fae', '6ce79232-af71-46d3-bc99-a2417f93df22', '43838372-a747-49a4-bb24-a0626a3913d8', 'cf86f86f-d31a-426c-baad-ec63d9695d17'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:04:38 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Delete snapshot completed successfully.
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-d2930161-cae0-4019-b2b1-45c51b9baf09-delete_snapshot" released by "delete_snapshot" :: held 3.826s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Snapshots deleted, issuing volume delete {{(pid=86851) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-d45e8799-945e-4adc-9d8a-7b257efb9beb" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-d45e8799-945e-4adc-9d8a-7b257efb9beb" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2885e6ed-d8bf-4600-84bb-a3cd6d500a9e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:39 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d4b266-c957-4a73-9138-fab7544f9b96 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72" returned: 0 in 0.851s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:39 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:04:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:39 devstack sudo[93494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72
Nov 03 08:04:39 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:39 devstack sudo[93484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb
Nov 03 08:04:39 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:39 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72" returned: 0 in 0.652s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:39 devstack sudo[93517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.info
Nov 03 08:04:39 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:40 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb" returned: 0 in 1.127s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:40 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb
Nov 03 08:04:40 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:40 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.info" returned: 0 in 0.634s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:40 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:04:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:40 devstack sudo[93524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.info
Nov 03 08:04:40 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:40 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d45e8799-945e-4adc-9d8a-7b257efb9beb" returned: 0 in 0.861s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-d45e8799-945e-4adc-9d8a-7b257efb9beb" released by "delete_volume" :: held 2.201s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:41 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Created reservations ['c04dbfe6-b372-4ae0-ad9d-16c0a6fdc424', '79c47e01-f076-4d66-b5a0-8cf82512911f', '36f0be4f-a195-44e8-bf1c-e24dfad7471d', '466f55df-6208-478e-9415-d27256f1a10d'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:04:41 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.info" returned: 0 in 0.736s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.971s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:41 devstack sudo[93532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:04:41 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:41 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-46a85b4d-c7e8-4e79-ac4d-bac9ed8d5c47 tempest-GroupSnapshotsTest-668021592 None] group_snapshot bfc00ec7-a413-4d72-9bf5-22d7be5adc8d: created successfully
Nov 03 08:04:42 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.715s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:42 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:04:42 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Deleted volume successfully.
Nov 03 08:04:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4709ae2f-9a85-4a70-9ec6-892cd6263831 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-d45e8799-945e-4adc-9d8a-7b257efb9beb-delete_volume" released by "delete_volume" :: held 7.394s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-1fdb810f-89ee-460b-9c39-c9e66261b351-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-1fdb810f-89ee-460b-9c39-c9e66261b351-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "cinder-quobyte-1fdb810f-89ee-460b-9c39-c9e66261b351" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-1fdb810f-89ee-460b-9c39-c9e66261b351" acquired by "delete_volume" :: waited 0.058s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:43 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[334f9b57-f102-42ad-a348-c913c59c4658]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:43 devstack sudo[93570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351
Nov 03 08:04:43 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:44 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351" returned: 0 in 1.413s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:44 devstack sudo[93605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351
Nov 03 08:04:44 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:45 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1fdb810f-89ee-460b-9c39-c9e66261b351" returned: 0 in 0.609s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-quobyte-1fdb810f-89ee-460b-9c39-c9e66261b351" released by "delete_volume" :: held 2.235s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:45 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Created reservations ['a5e3b458-15c4-41d2-890b-cf825ab6a9c8', 'e0f77685-d286-424e-8d48-841807dbcc50', 'db6a26a4-af53-49b6-91ac-44767f823258', '16b1de3c-e773-4d96-9eac-94c8c661b2d1'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:04:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-7b3b5791-93cc-458a-b91f-cd5772f56e72-7ef70d9d-9cdd-4509-855f-01afec6e51dd" by "_create_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-7b3b5791-93cc-458a-b91f-cd5772f56e72-7ef70d9d-9cdd-4509-855f-01afec6e51dd" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Creating volume 7ef70d9d-9cdd-4509-855f-01afec6e51dd from snapshot 7b3b5791-93cc-458a-b91f-cd5772f56e72 {{(pid=86851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-7ef70d9d-9cdd-4509-855f-01afec6e51dd" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-7ef70d9d-9cdd-4509-855f-01afec6e51dd" acquired by "_copy_volume_from_snapshot" :: waited 0.122s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] snapshot: 7b3b5791-93cc-458a-b91f-cd5772f56e72, volume: 7ef70d9d-9cdd-4509-855f-01afec6e51dd,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:04:46 devstack sudo[93614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:04:46 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d41a2c-1add-40df-8bc5-da2fb7d37ca3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:46 devstack sudo[93616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72
Nov 03 08:04:46 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:47 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 1.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:47 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:04:47 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Deleted volume successfully.
Nov 03 08:04:47 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72" returned: 0 in 0.987s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29d4b266-c957-4a73-9138-fab7544f9b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:04:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7b10c324-a29f-4bea-844a-78608f577222 tempest-VolumesDeleteCascade-1811852178 None] Lock "cinder-1fdb810f-89ee-460b-9c39-c9e66261b351-delete_volume" released by "delete_volume" :: held 4.495s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:04:47 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0887c672-8ca6-4b35-860f-18526f8fd464]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:04:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:47 devstack sudo[93622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96
Nov 03 08:04:47 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:48 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root
Nov 03 08:04:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96" returned: 0 in 1.094s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:04:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:04:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:04:48 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:04:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:04:48 devstack sudo[93633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd
Nov 03 08:04:48 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:04:56 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=30,cinder:INSERT=10,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:04:57 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=24,cinder:DELETE=2,cinder:SELECT=22,cinder:INSERT=5 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:05:01 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Flow 'volume_create_manager' (a09e50a1-0c34-4ac9-81f5-b67f7f979ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060008eb-60a7-48c5-a716-f3841dfb344c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060008eb-60a7-48c5-a716-f3841dfb344c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-982680115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3bac64-47f0-4e56-a525-01c3024b0c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc63b9352dad4e3e940ce5eaaf5e557a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:02Z,use_quota=True,user_id='e1d07a8772184910b64d528ae280960c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e32354-145e-4cba-8c2a-5e632b5909cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e32354-145e-4cba-8c2a-5e632b5909cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb067c32-a90f-4eb1-a3df-04d763906d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb067c32-a90f-4eb1-a3df-04d763906d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d3bac64-47f0-4e56-a525-01c3024b0c2d', 'volume_name': 'volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e312661-4660-4a61-b0c7-f9e01b0a5f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e312661-4660-4a61-b0c7-f9e01b0a5f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43eca86e-1e63-4a84-ad79-e4a3e6f92e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:02 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Volume 9d3bac64-47f0-4e56-a525-01c3024b0c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d', 'volume_size': 1}
Nov 03 08:05:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:03 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd" returned: 0 in 14.436s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96, size 1024.00 MB, duration 14.44 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:05:03 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Converted 1024.00 MB image at 70.93 MB/s
Nov 03 08:05:03 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:03 devstack sudo[93739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd
Nov 03 08:05:03 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:03 devstack sudo[93741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:03 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:03 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd" returned: 0 in 0.382s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-7ef70d9d-9cdd-4509-855f-01afec6e51dd" released by "_copy_volume_from_snapshot" :: held 17.257s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-7b3b5791-93cc-458a-b91f-cd5772f56e72-7ef70d9d-9cdd-4509-855f-01afec6e51dd" released by "_create_volume_from_snapshot" :: held 17.480s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:03 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.517s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-982680115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3bac64-47f0-4e56-a525-01c3024b0c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc63b9352dad4e3e940ce5eaaf5e557a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:02Z,use_quota=True,user_id='e1d07a8772184910b64d528ae280960c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Creating volume 9d3bac64-47f0-4e56-a525-01c3024b0c2d {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:03 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.399s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:03 devstack sudo[93746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d 1073741824
Nov 03 08:05:03 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:05:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:05:03 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b2ccc9f8-0b7b-4378-99ce-0476c8afe421 tempest-GroupSnapshotsTest-668021592 None] Create group from source-snapshot-bfc00ec7-a413-4d72-9bf5-22d7be5adc8d completed successfully.
Nov 03 08:05:04 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d 1073741824" returned: 0 in 0.562s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:04 devstack sudo[93752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d
Nov 03 08:05:04 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:04 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d" returned: 0 in 0.327s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43eca86e-1e63-4a84-ad79-e4a3e6f92e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d7fcdf-c0d1-4ff8-9c5d-7d4f251d337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:04 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Volume volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d (9d3bac64-47f0-4e56-a525-01c3024b0c2d): created successfully
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d7fcdf-c0d1-4ff8-9c5d-7d4f251d337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Flow 'volume_create_manager' (a09e50a1-0c34-4ac9-81f5-b67f7f979ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:04 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c012c2d8-dc25-4e26-a9d9-8e9c4ef8651a tempest-ServerRescueNegativeTestJSON-3133584 None] Created volume successfully.
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-7ef70d9d-9cdd-4509-855f-01afec6e51dd" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-7ef70d9d-9cdd-4509-855f-01afec6e51dd" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2295fa7-c05a-4c01-8c01-32ca811c9c9c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Flow 'volume_create_manager' (1f5bb7e4-16db-4c83-8e12-8d5b19370d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5aca3aa-13d9-4d25-9515-3cf41af230ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5aca3aa-13d9-4d25-9515-3cf41af230ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-502111318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56364b9-6386-490e-8baa-9be3c63ff3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e6abe14d44c2495ebe85caa55e080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:05Z,use_quota=True,user_id='a91a7bdcdd0041bd8fb49fab0054a833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:05 devstack sudo[93755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd
Nov 03 08:05:05 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade1e543-c8ab-4a8e-8346-4b966f8f6dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade1e543-c8ab-4a8e-8346-4b966f8f6dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c542ee9-e319-4c13-8080-8da8daa865aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c542ee9-e319-4c13-8080-8da8daa865aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56364b9-6386-490e-8baa-9be3c63ff3c2', 'volume_name': 'volume-e56364b9-6386-490e-8baa-9be3c63ff3c2', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fbe770-a388-414c-85bc-e24d27241932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fbe770-a388-414c-85bc-e24d27241932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9064667d-cd21-4dcd-affd-06307efdfd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Volume e56364b9-6386-490e-8baa-9be3c63ff3c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56364b9-6386-490e-8baa-9be3c63ff3c2', 'volume_size': 1}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-502111318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56364b9-6386-490e-8baa-9be3c63ff3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e6abe14d44c2495ebe85caa55e080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:05Z,use_quota=True,user_id='a91a7bdcdd0041bd8fb49fab0054a833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Creating volume e56364b9-6386-490e-8baa-9be3c63ff3c2 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:05 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:05 devstack sudo[93758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2 1073741824
Nov 03 08:05:05 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:05 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd" returned: 0 in 0.624s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:05 devstack sudo[93763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd
Nov 03 08:05:05 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:05 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7ef70d9d-9cdd-4509-855f-01afec6e51dd" returned: 0 in 0.323s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-7ef70d9d-9cdd-4509-855f-01afec6e51dd" released by "delete_volume" :: held 1.023s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:05 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2 1073741824" returned: 0 in 0.637s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Created reservations ['78823450-42b5-4fc0-a2e8-069c4c57ffce'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:06 devstack sudo[93770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2
Nov 03 08:05:06 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:06 devstack cinder-volume[86851]: WARNING cinder.quota [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-268728347 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-268728347, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:05:06 devstack cinder-volume[86851]: WARNING cinder.quota [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-268728347 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-268728347, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Created reservations ['e8c5fed5-f1b9-4c8a-bd33-1fbed98b9a70', '0cb1ee60-9abb-45f9-a966-f58a848dc367', '5a3206a7-bbcb-4ffb-9580-0295d0ce63a0', '38a85862-f80c-4285-9b03-2ef9e51dc50d'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:06 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2" returned: 0 in 0.318s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:06 devstack sudo[93773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:06 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9064667d-cd21-4dcd-affd-06307efdfd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56364b9-6386-490e-8baa-9be3c63ff3c2', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f027f69f-a647-493b-bdbf-ca574ce85281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:06 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Volume volume-e56364b9-6386-490e-8baa-9be3c63ff3c2 (e56364b9-6386-490e-8baa-9be3c63ff3c2): created successfully
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f027f69f-a647-493b-bdbf-ca574ce85281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Flow 'volume_create_manager' (1f5bb7e4-16db-4c83-8e12-8d5b19370d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-58c7d3fc-8272-4047-bc3b-9d07b28dc62a tempest-VolumesTransfersV355Test-1578476732 None] Created volume successfully.
Nov 03 08:05:06 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.334s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:06 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-dc1d6bb5-7bf3-4a53-8b43-ed61eb0a5635 tempest-GroupSnapshotsTest-668021592 None] Delete group completed successfully.
Nov 03 08:05:07 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] group_snapshot bfc00ec7-a413-4d72-9bf5-22d7be5adc8d: deleting
Nov 03 08:05:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] group_snapshot bfc00ec7-a413-4d72-9bf5-22d7be5adc8d: deleting {{(pid=86851) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 08:05:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-29d4b266-c957-4a73-9138-fab7544f9b96" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-29d4b266-c957-4a73-9138-fab7544f9b96" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-7b3b5791-93cc-458a-b91f-cd5772f56e72" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-7b3b5791-93cc-458a-b91f-cd5772f56e72" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Deleting offline snapshot 7b3b5791-93cc-458a-b91f-cd5772f56e72 of volume 29d4b266-c957-4a73-9138-fab7544f9b96 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:05:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] snapshot_file for this snap is: volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:05:07 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[29841987-78c9-4622-9d0f-c630fa7fa27d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:08 devstack sudo[93812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72
Nov 03 08:05:08 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-478f39b1-024e-4df0-9e9a-d9801fcfe1ee tempest-VolumesTransfersV355Test-1384458180 None] Transfer volume completed successfully.
Nov 03 08:05:08 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72" returned: 0 in 0.753s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29d4b266-c957-4a73-9138-fab7544f9b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:05:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[671119e8-2ad6-4aa0-b729-5f67907d1bc4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:08 devstack sudo[93841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96
Nov 03 08:05:08 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Acquiring lock "cinder-e56364b9-6386-490e-8baa-9be3c63ff3c2-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Lock "cinder-e56364b9-6386-490e-8baa-9be3c63ff3c2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Acquiring lock "cinder-quobyte-e56364b9-6386-490e-8baa-9be3c63ff3c2" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Lock "cinder-quobyte-e56364b9-6386-490e-8baa-9be3c63ff3c2" acquired by "delete_volume" :: waited 0.040s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:09 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f396eee-fa40-48d2-8e03-4fa4dcabf5a2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:09 devstack sudo[93846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2
Nov 03 08:05:09 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:09 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96" returned: 0 in 0.875s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:09 devstack sudo[93849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72
Nov 03 08:05:09 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:09 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2" returned: 0 in 0.604s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:09 devstack sudo[93856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2
Nov 03 08:05:09 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:10 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72" returned: 0 in 0.626s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:10 devstack sudo[93860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72
Nov 03 08:05:10 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:10 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e56364b9-6386-490e-8baa-9be3c63ff3c2" returned: 0 in 0.399s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Lock "cinder-quobyte-e56364b9-6386-490e-8baa-9be3c63ff3c2" released by "delete_volume" :: held 1.102s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Created reservations ['2a3bd821-fdc3-463f-8f8b-6dbc1f4ee9a0', '50b6fe95-d1ff-4ee4-a0ec-a2742fd11e34', 'db658835-4bea-4818-b822-73c280d5a75f', '31a5d46f-018d-4331-9e98-dd29f41f8ff4'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:10 devstack sudo[93864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:10 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:10 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96.7b3b5791-93cc-458a-b91f-cd5772f56e72" returned: 0 in 0.543s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-7b3b5791-93cc-458a-b91f-cd5772f56e72" released by "_delete_snapshot" :: held 3.093s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-29d4b266-c957-4a73-9138-fab7544f9b96" released by "delete_snapshot" :: held 3.152s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:10 devstack cinder-volume[86851]: WARNING cinder.quota [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-268728347 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-268728347, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] Created reservations ['aff29604-c4ba-45b1-9e1b-8343a8149fb3', 'e203d0bf-ba69-4261-abe0-3fa9beccc49e', '1db50404-6126-4093-81a8-1a0e9e3654b8', '06d3ee98-dfa4-4c29-a8b2-67e3b21221f9'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:10 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.350s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:10 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Deleted volume successfully.
Nov 03 08:05:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b2f745f2-5cf9-4a3b-b8a2-9d9c596c0ee3 tempest-VolumesTransfersV355Test-432574213 None] Lock "cinder-e56364b9-6386-490e-8baa-9be3c63ff3c2-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-827a6aee-5ed6-4489-bd43-4f2332bb2e08 tempest-GroupSnapshotsTest-668021592 None] group_snapshot bfc00ec7-a413-4d72-9bf5-22d7be5adc8d: deleted successfully
Nov 03 08:05:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-29d4b266-c957-4a73-9138-fab7544f9b96" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-29d4b266-c957-4a73-9138-fab7544f9b96" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:11 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf29250b-ae6e-4108-a0c8-43bf63cd2ca3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:11 devstack sudo[93894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96
Nov 03 08:05:11 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:12 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96" returned: 0 in 0.489s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:12 devstack sudo[93899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96
Nov 03 08:05:12 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Flow 'volume_create_manager' (1e242ab8-5392-47ed-bbcc-695cd3ec95ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95751981-f763-4ccb-a308-bb56471efd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95751981-f763-4ccb-a308-bb56471efd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-266057838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4add7c-20fd-4a97-8546-7a6980808192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e6abe14d44c2495ebe85caa55e080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:12Z,use_quota=True,user_id='a91a7bdcdd0041bd8fb49fab0054a833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f94aea7-28d8-496c-a037-c3e06f67c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f94aea7-28d8-496c-a037-c3e06f67c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a35999f-cf58-43ee-9ea0-901067cbc316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a35999f-cf58-43ee-9ea0-901067cbc316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef4add7c-20fd-4a97-8546-7a6980808192', 'volume_name': 'volume-ef4add7c-20fd-4a97-8546-7a6980808192', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab12c4b-7157-4d25-aff1-c67290f8a73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab12c4b-7157-4d25-aff1-c67290f8a73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734ed81e-1193-4265-a006-5b2a9179b366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:12 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Volume ef4add7c-20fd-4a97-8546-7a6980808192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef4add7c-20fd-4a97-8546-7a6980808192', 'volume_size': 1}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-266057838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4add7c-20fd-4a97-8546-7a6980808192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e6abe14d44c2495ebe85caa55e080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:12Z,use_quota=True,user_id='a91a7bdcdd0041bd8fb49fab0054a833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Creating volume ef4add7c-20fd-4a97-8546-7a6980808192 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:12 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:12 devstack sudo[93901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192 1073741824
Nov 03 08:05:12 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:12 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-29d4b266-c957-4a73-9138-fab7544f9b96" returned: 0 in 0.264s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-29d4b266-c957-4a73-9138-fab7544f9b96" released by "delete_volume" :: held 0.848s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Created reservations ['b5850c73-1368-4529-b7be-69c0f5ace2e3'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:12 devstack cinder-volume[86851]: WARNING cinder.db.api [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-268728347']
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Created reservations ['2b657748-eac1-4ccf-b4a8-66d50db0c472', '186dd13b-b6ad-403d-bc67-42bd9d1b7b00', '62254f44-b770-4320-ab0d-eb7efae3cb03', 'c4e66ee4-c4de-4661-ad26-7145791d1c9f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:12 devstack sudo[93908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:12 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:12 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192 1073741824" returned: 0 in 0.662s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:13 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.385s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ee622f97-7fce-4bab-9570-7280392bc19d tempest-GroupSnapshotsTest-668021592 None] Delete group completed successfully.
Nov 03 08:05:13 devstack sudo[93912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192
Nov 03 08:05:13 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:13 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192" returned: 0 in 0.373s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b58d5073-fa77-4ca6-bc8c-4dca5f1c44b7 tempest-GroupSnapshotsTest-668021592 None] Group tempest-GroupSnapshotsTest-Group-124275129: creating
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734ed81e-1193-4265-a006-5b2a9179b366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4add7c-20fd-4a97-8546-7a6980808192', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d91ec60-a81e-4046-b2c2-6f76bd693f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Volume volume-ef4add7c-20fd-4a97-8546-7a6980808192 (ef4add7c-20fd-4a97-8546-7a6980808192): created successfully
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d91ec60-a81e-4046-b2c2-6f76bd693f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Flow 'volume_create_manager' (1e242ab8-5392-47ed-bbcc-695cd3ec95ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b58d5073-fa77-4ca6-bc8c-4dca5f1c44b7 tempest-GroupSnapshotsTest-668021592 None] Group tempest-GroupSnapshotsTest-Group-124275129: created successfully
Nov 03 08:05:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b58d5073-fa77-4ca6-bc8c-4dca5f1c44b7 tempest-GroupSnapshotsTest-668021592 None] Create group completed successfully.
Nov 03 08:05:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5ccd9467-dd25-4e9d-846b-9f84a7166022 tempest-VolumesTransfersV355Test-1578476732 None] Created volume successfully.
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Acquiring lock "cinder-9d3bac64-47f0-4e56-a525-01c3024b0c2d-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Lock "cinder-9d3bac64-47f0-4e56-a525-01c3024b0c2d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Acquiring lock "cinder-quobyte-9d3bac64-47f0-4e56-a525-01c3024b0c2d" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Lock "cinder-quobyte-9d3bac64-47f0-4e56-a525-01c3024b0c2d" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda9ddd9-3bc2-4970-8c33-cf816e919b7c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:13 devstack sudo[93917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d
Nov 03 08:05:13 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:14 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d" returned: 0 in 0.406s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:14 devstack sudo[93924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d
Nov 03 08:05:14 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:14 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9d3bac64-47f0-4e56-a525-01c3024b0c2d" returned: 0 in 0.305s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Lock "cinder-quobyte-9d3bac64-47f0-4e56-a525-01c3024b0c2d" released by "delete_volume" :: held 0.772s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Created reservations ['fbdd52d5-71a6-4d98-85bb-37f65e05f551', '5ae59e54-2791-42f0-940f-a19709c04716', 'a4ece6d8-61a9-4f5e-8c32-74f31a265a55', 'a4669bba-2fac-4fec-b986-3e8b8ee66a34'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:14 devstack sudo[93927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:14 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Flow 'volume_create_manager' (4bf29577-7fe2-4ce8-8485-0f2dd084d217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36624cbc-5adb-4d6d-865e-4baac6c5d026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36624cbc-5adb-4d6d-865e-4baac6c5d026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1883859056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f46a9d3-7519-4b59-be43-24b5b962f806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e2c7b21a044939224bf525911ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:15Z,use_quota=True,user_id='2d23f11f8f5d478dac03532ba4924259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce000747-2694-4517-8c80-846b9f31c4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce000747-2694-4517-8c80-846b9f31c4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1920e360-49b4-4d3d-818c-4c821927011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1920e360-49b4-4d3d-818c-4c821927011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f46a9d3-7519-4b59-be43-24b5b962f806', 'volume_name': 'volume-5f46a9d3-7519-4b59-be43-24b5b962f806', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d156bcf-5f32-400c-980a-1114cad70fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d156bcf-5f32-400c-980a-1114cad70fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fabd4f-8c77-4a7b-bed5-c3861bf62e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:14 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Volume 5f46a9d3-7519-4b59-be43-24b5b962f806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f46a9d3-7519-4b59-be43-24b5b962f806', 'volume_size': 1}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1883859056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f46a9d3-7519-4b59-be43-24b5b962f806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e2c7b21a044939224bf525911ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:15Z,use_quota=True,user_id='2d23f11f8f5d478dac03532ba4924259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Creating volume 5f46a9d3-7519-4b59-be43-24b5b962f806 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:14 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:15 devstack sudo[93929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806 1073741824
Nov 03 08:05:15 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Acquiring lock "cinder-ef4add7c-20fd-4a97-8546-7a6980808192-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Lock "cinder-ef4add7c-20fd-4a97-8546-7a6980808192-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:15 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.765s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Acquiring lock "cinder-quobyte-ef4add7c-20fd-4a97-8546-7a6980808192" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:15 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:15 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Deleted volume successfully.
Nov 03 08:05:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Lock "cinder-quobyte-ef4add7c-20fd-4a97-8546-7a6980808192" acquired by "delete_volume" :: waited 0.047s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:15 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0c395a-6d7e-4784-8de6-c774bb281365]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2c0c87fd-6975-41f4-9b88-b85c2e68de74 tempest-ServerRescueNegativeTestJSON-3133584 None] Lock "cinder-9d3bac64-47f0-4e56-a525-01c3024b0c2d-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:15 devstack sudo[93942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192
Nov 03 08:05:15 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:16 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806 1073741824" returned: 0 in 1.351s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:16 devstack sudo[93966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806
Nov 03 08:05:16 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Flow 'volume_create_manager' (86361561-d691-447d-a154-ecfa7cae636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43a4170-5e9b-44fe-9056-9e6f3af0928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43a4170-5e9b-44fe-9056-9e6f3af0928e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-542887359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=52b0a9eb-30a2-489c-84b3-359542a25447,host='devstack@QuobyteHD#QuobyteHD',id=d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a9add118ca4d42b407e20591d3628b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:16Z,use_quota=True,user_id='9178a654037748238e5ad158a87a8691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ef5f4e0-e9ce-4a91-ab07-e38981609e20),volume_type_id=7ef5f4e0-e9ce-4a91-ab07-e38981609e20)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be03e027-5c80-438f-a7cf-37d51a89a917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be03e027-5c80-438f-a7cf-37d51a89a917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49b12c2-5ff4-43c4-937e-4658b769671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49b12c2-5ff4-43c4-937e-4658b769671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9abd8f6-2a47-4e9c-bc4a-c091e3fe6380', 'volume_name': 'volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4264914a-74ad-4b97-80c2-915e035c0a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4264914a-74ad-4b97-80c2-915e035c0a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e67b70-200f-4ef3-9184-8f8989f71f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:16 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Volume d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380', 'volume_size': 1}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:16 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192" returned: 0 in 1.320s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:16 devstack sudo[93980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192
Nov 03 08:05:16 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:17 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806" returned: 0 in 0.642s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.299s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=52b0a9eb-30a2-489c-84b3-359542a25447,created_at=2026-11-03T07:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-542887359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=52b0a9eb-30a2-489c-84b3-359542a25447,host='devstack@QuobyteHD#QuobyteHD',id=d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a9add118ca4d42b407e20591d3628b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:16Z,use_quota=True,user_id='9178a654037748238e5ad158a87a8691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ef5f4e0-e9ce-4a91-ab07-e38981609e20),volume_type_id=7ef5f4e0-e9ce-4a91-ab07-e38981609e20)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Creating volume d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:17 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fabd4f-8c77-4a7b-bed5-c3861bf62e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f46a9d3-7519-4b59-be43-24b5b962f806', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:17 devstack sudo[93985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 1073741824
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3faef2f-da88-4d6d-b9f7-5a35c9535989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:17 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:17 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Volume volume-5f46a9d3-7519-4b59-be43-24b5b962f806 (5f46a9d3-7519-4b59-be43-24b5b962f806): created successfully
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3faef2f-da88-4d6d-b9f7-5a35c9535989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Flow 'volume_create_manager' (4bf29577-7fe2-4ce8-8485-0f2dd084d217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5efdf79e-9c65-4654-bcb7-046c1ed49ff9 tempest-AttachVolumeTestJSON-833307314 None] Created volume successfully.
Nov 03 08:05:17 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef4add7c-20fd-4a97-8546-7a6980808192" returned: 0 in 0.509s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Lock "cinder-quobyte-ef4add7c-20fd-4a97-8546-7a6980808192" released by "delete_volume" :: held 1.965s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Created reservations ['72fd3e33-f3f0-4e94-81de-afdb5a13e739', '9e27d5b2-3c5f-4526-bbe8-3837c1eef1e9', '27086f06-6a7d-4417-ba78-93813427c0b4', 'ddf3a94d-62b6-412f-9956-7969fed77360'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:17 devstack sudo[94000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:17 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:18 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 1073741824" returned: 0 in 0.982s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:18 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.466s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Deleted volume successfully.
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:18 devstack sudo[94006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380
Nov 03 08:05:18 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-022258de-9e6c-46fb-94bf-54c137074a65 tempest-VolumesTransfersV355Test-432574213 None] Lock "cinder-ef4add7c-20fd-4a97-8546-7a6980808192-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:18 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" returned: 0 in 0.463s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e67b70-200f-4ef3-9184-8f8989f71f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd79db7e-1eb8-4c7d-b0a3-612d052956b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:18 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Volume volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 (d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380): created successfully
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd79db7e-1eb8-4c7d-b0a3-612d052956b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Flow 'volume_create_manager' (86361561-d691-447d-a154-ecfa7cae636f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-93dd2264-7d90-4b5e-8220-ccb7d2c1cae0 tempest-GroupSnapshotsTest-668021592 None] Created volume successfully.
Nov 03 08:05:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-71e56586-41ea-4cef-9f67-02ecfc922f99 req-a07df3c6-bc58-4dae-960a-d0183bf54222 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-71e56586-41ea-4cef-9f67-02ecfc922f99 req-a07df3c6-bc58-4dae-960a-d0183bf54222 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-71e56586-41ea-4cef-9f67-02ecfc922f99 req-a07df3c6-bc58-4dae-960a-d0183bf54222 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-71e56586-41ea-4cef-9f67-02ecfc922f99 req-a07df3c6-bc58-4dae-960a-d0183bf54222 tempest-AttachVolumeTestJSON-833307314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-5f46a9d3-7519-4b59-be43-24b5b962f806', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb97b35a-3e32-4713-bfb3-4792a40ea2b3', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:05:19 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-71e56586-41ea-4cef-9f67-02ecfc922f99 req-a07df3c6-bc58-4dae-960a-d0183bf54222 tempest-AttachVolumeTestJSON-833307314 None] attachment_update completed successfully.
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Flow 'volume_create_manager' (8259d895-3fb4-4567-ba75-d76639cfcf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a9e41f-cfc3-45d1-a310-5b8af6237017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a9e41f-cfc3-45d1-a310-5b8af6237017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-850502531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=52b0a9eb-30a2-489c-84b3-359542a25447,host='devstack@QuobyteHD#QuobyteHD',id=0d58d12f-280a-4f64-9137-a7b731908f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a9add118ca4d42b407e20591d3628b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:20Z,use_quota=True,user_id='9178a654037748238e5ad158a87a8691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ef5f4e0-e9ce-4a91-ab07-e38981609e20),volume_type_id=7ef5f4e0-e9ce-4a91-ab07-e38981609e20)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe04f7b2-c138-4231-a8ce-f505ce19c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe04f7b2-c138-4231-a8ce-f505ce19c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de55bbd6-53cd-45f7-9973-0cdcf9e7589a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de55bbd6-53cd-45f7-9973-0cdcf9e7589a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d58d12f-280a-4f64-9137-a7b731908f95', 'volume_name': 'volume-0d58d12f-280a-4f64-9137-a7b731908f95', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064b9ffa-8077-41ad-a26d-d5dea34d76ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064b9ffa-8077-41ad-a26d-d5dea34d76ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae97ba2d-f981-480e-b7cc-1b67688bafca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:20 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Volume 0d58d12f-280a-4f64-9137-a7b731908f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d58d12f-280a-4f64-9137-a7b731908f95', 'volume_size': 1}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=52b0a9eb-30a2-489c-84b3-359542a25447,created_at=2026-11-03T07:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-850502531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=52b0a9eb-30a2-489c-84b3-359542a25447,host='devstack@QuobyteHD#QuobyteHD',id=0d58d12f-280a-4f64-9137-a7b731908f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a9add118ca4d42b407e20591d3628b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:20Z,use_quota=True,user_id='9178a654037748238e5ad158a87a8691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ef5f4e0-e9ce-4a91-ab07-e38981609e20),volume_type_id=7ef5f4e0-e9ce-4a91-ab07-e38981609e20)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Creating volume 0d58d12f-280a-4f64-9137-a7b731908f95 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:20 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:20 devstack sudo[94440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95 1073741824
Nov 03 08:05:20 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:21 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95 1073741824" returned: 0 in 0.911s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:21 devstack sudo[94466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95
Nov 03 08:05:21 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:21 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95" returned: 0 in 0.330s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae97ba2d-f981-480e-b7cc-1b67688bafca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d58d12f-280a-4f64-9137-a7b731908f95', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26df887-2db9-4753-aefd-60d527344fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:22 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Volume volume-0d58d12f-280a-4f64-9137-a7b731908f95 (0d58d12f-280a-4f64-9137-a7b731908f95): created successfully
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26df887-2db9-4753-aefd-60d527344fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Flow 'volume_create_manager' (8259d895-3fb4-4567-ba75-d76639cfcf6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3f0e4316-0d56-44ab-93b0-b1112c8527e7 tempest-GroupSnapshotsTest-668021592 None] Created volume successfully.
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Flow 'volume_create_manager' (83c179a2-dc4f-4410-853e-705874ca4f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66462f9-5790-4fce-bb11-e177f91fba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66462f9-5790-4fce-bb11-e177f91fba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-771190858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc7f9bd-8808-4631-a3bb-ca70a20c39ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e2c7b21a044939224bf525911ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:23Z,use_quota=True,user_id='2d23f11f8f5d478dac03532ba4924259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (368eee90-6163-48b1-a6da-8b01d015cd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (368eee90-6163-48b1-a6da-8b01d015cd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9a7c27-52c0-44a0-bd27-63483c24e6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9a7c27-52c0-44a0-bd27-63483c24e6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc7f9bd-8808-4631-a3bb-ca70a20c39ec', 'volume_name': 'volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2838fc3f-4cd9-41dc-940c-303d71b92301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2838fc3f-4cd9-41dc-940c-303d71b92301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef098ed-139d-453b-afa4-76142c91158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:22 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Volume 6bc7f9bd-8808-4631-a3bb-ca70a20c39ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec', 'volume_size': 1}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-771190858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc7f9bd-8808-4631-a3bb-ca70a20c39ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e2c7b21a044939224bf525911ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:23Z,use_quota=True,user_id='2d23f11f8f5d478dac03532ba4924259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Creating volume 6bc7f9bd-8808-4631-a3bb-ca70a20c39ec {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:22 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:22 devstack sudo[94471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec 1073741824
Nov 03 08:05:22 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-6a560967-1fff-4acf-932f-bc0f1ece64f1 tempest-GroupSnapshotsTest-668021592 None] Update group completed successfully.
Nov 03 08:05:23 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec 1073741824" returned: 0 in 0.545s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:23 devstack sudo[94478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec
Nov 03 08:05:23 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:23 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec" returned: 0 in 0.311s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef098ed-139d-453b-afa4-76142c91158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd411b3-1957-4907-901c-b0d83ccc759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:23 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Volume volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec (6bc7f9bd-8808-4631-a3bb-ca70a20c39ec): created successfully
Nov 03 08:05:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd411b3-1957-4907-901c-b0d83ccc759b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Flow 'volume_create_manager' (83c179a2-dc4f-4410-853e-705874ca4f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d842f5bd-18aa-411f-8416-7fb0cc715ec8 tempest-AttachVolumeTestJSON-833307314 None] Created volume successfully.
Nov 03 08:05:24 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b44191ba-3cfd-4d6f-85d5-8514cb3c4b05 tempest-GroupSnapshotsTest-668021592 None] Update group completed successfully.
Nov 03 08:05:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fc15ad81-def3-4bbd-888a-0a88b898c743 req-b43f1c55-a3d4-471e-85a5-5ff57cb64132 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fc15ad81-def3-4bbd-888a-0a88b898c743 req-b43f1c55-a3d4-471e-85a5-5ff57cb64132 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-fc15ad81-def3-4bbd-888a-0a88b898c743 req-b43f1c55-a3d4-471e-85a5-5ff57cb64132 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-fc15ad81-def3-4bbd-888a-0a88b898c743 req-b43f1c55-a3d4-471e-85a5-5ff57cb64132 tempest-AttachVolumeTestJSON-833307314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2019a88-ccce-4dae-b63d-6b5ee42e672c', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:05:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-fc15ad81-def3-4bbd-888a-0a88b898c743 req-b43f1c55-a3d4-471e-85a5-5ff57cb64132 tempest-AttachVolumeTestJSON-833307314 None] attachment_update completed successfully.
Nov 03 08:05:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ebda24fa-b77e-44b1-998d-c578019308ec tempest-GroupSnapshotsTest-668021592 None] Update group completed successfully.
Nov 03 08:05:26 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-720755c7-0e0b-42c0-8ada-6b28d2798d17 tempest-GroupSnapshotsTest-668021592 None] Update group completed successfully.
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Flow 'volume_create_manager' (548a6aec-ea2b-4897-926c-879aa9fb298a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d93ed7-e7bc-4ac5-97dc-9f9c91858296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d93ed7-e7bc-4ac5-97dc-9f9c91858296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-912438293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a4b1f5-e7b9-4020-a83b-a382e7538aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f4611f344244878cbf7ef29494ec1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:27Z,use_quota=True,user_id='1d34653b3d534b69b494e77fa6b5f6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de443fa-8213-4841-9bd9-7d25effdff36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de443fa-8213-4841-9bd9-7d25effdff36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8355aa89-dc09-4c0d-a3a9-7a3a986cd7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8355aa89-dc09-4c0d-a3a9-7a3a986cd7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a4b1f5-e7b9-4020-a83b-a382e7538aea', 'volume_name': 'volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8331c743-be62-4039-8ff8-6625c42c6eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8331c743-be62-4039-8ff8-6625c42c6eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3473f0-fd48-4716-9d42-4688185fc41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:27 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Volume 37a4b1f5-e7b9-4020-a83b-a382e7538aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea', 'volume_size': 1}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-912438293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a4b1f5-e7b9-4020-a83b-a382e7538aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f4611f344244878cbf7ef29494ec1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:27Z,use_quota=True,user_id='1d34653b3d534b69b494e77fa6b5f6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Creating volume 37a4b1f5-e7b9-4020-a83b-a382e7538aea {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:27 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:27 devstack sudo[94501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea 1073741824
Nov 03 08:05:27 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:27 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-6d596f5a-90b2-4024-864c-9b49ccfd93f3 req-165ef067-2af9-4acf-a7ff-0c8e732ee225 tempest-AttachVolumeTestJSON-833307314 None] Terminate volume connection completed successfully.
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-6d596f5a-90b2-4024-864c-9b49ccfd93f3 req-165ef067-2af9-4acf-a7ff-0c8e732ee225 tempest-AttachVolumeTestJSON-833307314 None] Deleting attachment cb97b35a-3e32-4713-bfb3-4792a40ea2b3. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:05:27 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea 1073741824" returned: 0 in 0.522s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:27 devstack sudo[94509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea
Nov 03 08:05:27 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:27 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea" returned: 0 in 0.256s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3473f0-fd48-4716-9d42-4688185fc41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fb280c-2f77-47d0-bfe6-d692f61154c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:28 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Volume volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea (37a4b1f5-e7b9-4020-a83b-a382e7538aea): created successfully
Nov 03 08:05:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fb280c-2f77-47d0-bfe6-d692f61154c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Flow 'volume_create_manager' (548a6aec-ea2b-4897-926c-879aa9fb298a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:28 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9337fb10-313f-4503-9d79-dabffcd259a0 tempest-VolumesCloneTest-577896834 None] Created volume successfully.
Nov 03 08:05:28 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] GroupSnapshot b9d6965a-8229-4e8b-b719-66832ddd3af1: creating.
Nov 03 08:05:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Group snapshot b9d6965a-8229-4e8b-b719-66832ddd3af1: creating. {{(pid=86851) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 08:05:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Creating offline snapshot 4c731f6a-f280-4016-ae82-f96e84838a48 of volume 0d58d12f-280a-4f64-9137-a7b731908f95 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:05:28 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf88d3a-8056-4a08-b1ad-ef56d9567c7a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:28 devstack sudo[94513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95
Nov 03 08:05:28 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:28 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-56cf61b6-5f9e-48b9-a56e-c23583d213e4 req-9de35931-2a0d-430e-88b1-47b078584665 tempest-AttachVolumeTestJSON-833307314 None] Terminate volume connection completed successfully.
Nov 03 08:05:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-56cf61b6-5f9e-48b9-a56e-c23583d213e4 req-9de35931-2a0d-430e-88b1-47b078584665 tempest-AttachVolumeTestJSON-833307314 None] Deleting attachment b2019a88-ccce-4dae-b63d-6b5ee42e672c. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:05:29 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95" returned: 0 in 0.516s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:29 devstack sudo[94545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48 1G
Nov 03 08:05:29 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:29 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48 1G" returned: 0 in 0.817s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d58d12f-280a-4f64-9137-a7b731908f95 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:29 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d58d12f-280a-4f64-9137-a7b731908f95 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48
Nov 03 08:05:29 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:29 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Flow 'volume_create_manager' (f3be9e76-abd8-45e6-be7a-5fef88d3c858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d422e785-a3be-44f9-9588-8be0543fa9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d422e785-a3be-44f9-9588-8be0543fa9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1246327576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b25997-d37f-40b4-8a21-c2b9421773d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f4611f344244878cbf7ef29494ec1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=37a4b1f5-e7b9-4020-a83b-a382e7538aea,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:30Z,use_quota=True,user_id='1d34653b3d534b69b494e77fa6b5f6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d6ecda-d819-47b0-a33b-3f67e15ad365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d6ecda-d819-47b0-a33b-3f67e15ad365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de77b452-cc68-4956-9fce-1c55768f2035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de77b452-cc68-4956-9fce-1c55768f2035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b4b25997-d37f-40b4-8a21-c2b9421773d4', 'volume_name': 'volume-b4b25997-d37f-40b4-8a21-c2b9421773d4', 'volume_size': 2, 'source_volid': '37a4b1f5-e7b9-4020-a83b-a382e7538aea', 'source_volstatus': 'available'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af41b52-7134-4e41-b478-7d166de7dc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af41b52-7134-4e41-b478-7d166de7dc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93aaf58b-cdee-44c2-850d-77a29c76dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:30 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Volume b4b25997-d37f-40b4-8a21-c2b9421773d4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b4b25997-d37f-40b4-8a21-c2b9421773d4', 'volume_size': 2, 'source_volid': '37a4b1f5-e7b9-4020-a83b-a382e7538aea', 'source_volstatus': 'available'}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:30 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d58d12f-280a-4f64-9137-a7b731908f95 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48" returned: 0 in 0.421s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:30 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:30 devstack sudo[94592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48
Nov 03 08:05:30 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:30 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48" returned: 0 in 0.336s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:30 devstack sudo[94596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.info
Nov 03 08:05:30 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:31 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.info" returned: 0 in 0.427s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:31 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:31 devstack sudo[94614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.info
Nov 03 08:05:31 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:31 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.info" returned: 0 in 0.298s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.946s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Creating offline snapshot 666a808b-0b36-43c7-a579-6af78a59e008 of volume d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[46063c25-4f58-4b7a-b33a-911bef089704]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:31 devstack sudo[94622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380
Nov 03 08:05:31 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:31 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" returned: 0 in 0.404s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:31 devstack sudo[94628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008 1G
Nov 03 08:05:31 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:32 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008 1G" returned: 0 in 0.563s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:32 devstack sudo[94635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008
Nov 03 08:05:32 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:32 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008" returned: 0 in 0.336s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:32 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:05:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:32 devstack sudo[94641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008
Nov 03 08:05:32 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:33 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008" returned: 0 in 0.277s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:33 devstack sudo[94644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.info
Nov 03 08:05:33 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:33 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.info" returned: 0 in 0.258s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:33 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:33 devstack sudo[94648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.info
Nov 03 08:05:33 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Flow 'volume_create_manager' (2a379121-b9c0-4a43-abc9-f60e5e3818a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e02e3ac-6682-4335-adce-74ae8e28c067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:33 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e02e3ac-6682-4335-adce-74ae8e28c067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-563994447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3d26ba-12c5-42df-a8ac-90c943dce18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04210aae8cbf431ca98040604576cb5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:34Z,use_quota=True,user_id='0a884cd851da44879c072c881a5b18ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f003110-a3dc-4365-b8ef-160e9568ff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f003110-a3dc-4365-b8ef-160e9568ff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d57051-17ab-4ad1-95e3-ec9345370299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d57051-17ab-4ad1-95e3-ec9345370299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3d26ba-12c5-42df-a8ac-90c943dce18c', 'volume_name': 'volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87e382e-a17c-42f0-9542-5881f2f24514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87e382e-a17c-42f0-9542-5881f2f24514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13742a9e-f8eb-4ea6-888a-1b8f13eeef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:33 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Volume 0a3d26ba-12c5-42df-a8ac-90c943dce18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c', 'volume_size': 1}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.info" returned: 0 in 0.339s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.300s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.512s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:33 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Cloning volume 37a4b1f5-e7b9-4020-a83b-a382e7538aea to volume b4b25997-d37f-40b4-8a21-c2b9421773d4
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Creating offline snapshot 09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 of volume 37a4b1f5-e7b9-4020-a83b-a382e7538aea {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e8a110-c644-4058-9ada-a3a4105299a6]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:33 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-df3fc5e8-6a9f-4ef2-8963-a0f560e3098f tempest-GroupSnapshotsTest-668021592 None] group_snapshot b9d6965a-8229-4e8b-b719-66832ddd3af1: created successfully
Nov 03 08:05:33 devstack sudo[94652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea
Nov 03 08:05:33 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:34 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea" returned: 0 in 0.393s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:34 devstack sudo[94657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 1G
Nov 03 08:05:34 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "cinder-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "cinder-quobyte-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-quobyte-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e50af5-53b8-48ac-9db0-82cf7d21ad3a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:34 devstack sudo[94662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec
Nov 03 08:05:34 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:34 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 1G" returned: 0 in 0.438s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:34 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7
Nov 03 08:05:34 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:34 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec" returned: 0 in 0.414s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:34 devstack sudo[94672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec
Nov 03 08:05:34 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:34 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:34 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] group_snapshot b9d6965a-8229-4e8b-b719-66832ddd3af1: deleting
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7" returned: 0 in 0.349s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:34 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 is being set with open permissions: ugo+rw
Nov 03 08:05:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] group_snapshot b9d6965a-8229-4e8b-b719-66832ddd3af1: deleting {{(pid=86851) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 08:05:35 devstack sudo[94675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7
Nov 03 08:05:35 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-0d58d12f-280a-4f64-9137-a7b731908f95" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-0d58d12f-280a-4f64-9137-a7b731908f95" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-4c731f6a-f280-4016-ae82-f96e84838a48" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-4c731f6a-f280-4016-ae82-f96e84838a48" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Deleting offline snapshot 4c731f6a-f280-4016-ae82-f96e84838a48 of volume 0d58d12f-280a-4f64-9137-a7b731908f95 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] snapshot_file for this snap is: volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c130a12-7562-4c07-af9c-3e3f09fde80b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:35 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec" returned: 0 in 0.276s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-quobyte-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec" released by "delete_volume" :: held 0.743s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Created reservations ['42695d04-c8d3-40e8-8887-8b69d2a7ee48', '566bebbd-93b4-41d8-936a-4135f1fd67d6', '1f3aad04-e0c5-4b88-8e18-3873cbfeea53', '4647532a-5273-4bf1-b8da-d77a05269094'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:35 devstack sudo[94678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48
Nov 03 08:05:35 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:35 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7" returned: 0 in 0.349s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:35 devstack sudo[94681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:35 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:35 devstack sudo[94683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.info
Nov 03 08:05:35 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "cinder-5f46a9d3-7519-4b59-be43-24b5b962f806-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-5f46a9d3-7519-4b59-be43-24b5b962f806-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:35 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48" returned: 0 in 0.523s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d58d12f-280a-4f64-9137-a7b731908f95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:05:35 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:35 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[614e202f-5de8-44ea-9318-966a9fc0efd2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.info" returned: 0 in 0.342s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:35 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.info is being set with open permissions: ugo+rw
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.403s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "cinder-quobyte-5f46a9d3-7519-4b59-be43-24b5b962f806" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Deleted volume successfully.
Nov 03 08:05:35 devstack sudo[94692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.info
Nov 03 08:05:35 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-quobyte-5f46a9d3-7519-4b59-be43-24b5b962f806" acquired by "delete_volume" :: waited 0.043s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-231b2284-518b-4752-8222-5dce72f8df37 tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-6bc7f9bd-8808-4631-a3bb-ca70a20c39ec-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d60d10-bc00-4a00-918d-981986d6689a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:35 devstack sudo[94691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95
Nov 03 08:05:35 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:35 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806
Nov 03 08:05:35 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:36 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.info" returned: 0 in 0.276s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Acquiring lock "cinder-quobyte-b4b25997-d37f-40b4-8a21-c2b9421773d4" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Lock "cinder-quobyte-b4b25997-d37f-40b4-8a21-c2b9421773d4" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] snapshot: 09d0b9c6-0ddd-4aa9-9a34-a513d97775b7, volume: b4b25997-d37f-40b4-8a21-c2b9421773d4,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6265d42-84fc-4cfa-87d8-35bdc4ab1058]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:36 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95" returned: 0 in 0.381s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:36 devstack sudo[94702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48
Nov 03 08:05:36 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:36 devstack sudo[94701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7
Nov 03 08:05:36 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:36 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806" returned: 0 in 0.389s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:36 devstack sudo[94708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806
Nov 03 08:05:36 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:36 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48" returned: 0 in 0.366s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:36 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7" returned: 0 in 0.403s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:05:36 devstack sudo[94717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48
Nov 03 08:05:36 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323f7dd-610e-4c59-a126-7af1895008d2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:36 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5f46a9d3-7519-4b59-be43-24b5b962f806" returned: 0 in 0.322s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-quobyte-5f46a9d3-7519-4b59-be43-24b5b962f806" released by "delete_volume" :: held 0.763s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Created reservations ['2287a99f-fe5f-46d3-9175-ecf2352e5928', '1740c354-fe37-4a99-9ec6-86365c8d838d', 'bdee38f7-2043-4fcb-a443-b6e8bc324137', 'fec768c1-d5a0-49a4-ab2f-9665ce259045'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:36 devstack sudo[94720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea
Nov 03 08:05:36 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:36 devstack sudo[94723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:36 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:36 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95.4c731f6a-f280-4016-ae82-f96e84838a48" returned: 0 in 0.305s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-4c731f6a-f280-4016-ae82-f96e84838a48" released by "_delete_snapshot" :: held 1.764s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-0d58d12f-280a-4f64-9137-a7b731908f95" released by "delete_snapshot" :: held 1.790s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-666a808b-0b36-43c7-a579-6af78a59e008" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-666a808b-0b36-43c7-a579-6af78a59e008" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Deleting offline snapshot 666a808b-0b36-43c7-a579-6af78a59e008 of volume d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] snapshot_file for this snap is: volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:05:36 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea" returned: 0 in 0.441s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4 not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c16b96-b621-4187-864c-84df849b4d81]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "cinder-6e1b215d-c220-49ec-bed4-d9bc72dfa81a-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:36 devstack sudo[94728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4
Nov 03 08:05:36 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:37 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.335s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:37 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Deleted volume successfully.
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-6e1b215d-c220-49ec-bed4-d9bc72dfa81a-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0dda6aa-7996-4dd8-b537-8553ba4d3f2d tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-5f46a9d3-7519-4b59-be43-24b5b962f806-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "cinder-quobyte-6e1b215d-c220-49ec-bed4-d9bc72dfa81a" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-quobyte-6e1b215d-c220-49ec-bed4-d9bc72dfa81a" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:37 devstack sudo[94731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008
Nov 03 08:05:37 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95519a4-38ad-4f16-b906-2f3c64f6ba2c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:37 devstack sudo[94733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a
Nov 03 08:05:37 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:37 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008" returned: 0 in 0.414s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbdafbf-e646-41c8-8ecc-e014fcd11e9a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:37 devstack sudo[94743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380
Nov 03 08:05:37 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:37 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a" returned: 0 in 0.585s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:37 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a
Nov 03 08:05:37 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:38 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" returned: 0 in 0.605s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:38 devstack sudo[94760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008
Nov 03 08:05:38 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:38 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e1b215d-c220-49ec-bed4-d9bc72dfa81a" returned: 0 in 0.431s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-quobyte-6e1b215d-c220-49ec-bed4-d9bc72dfa81a" released by "delete_volume" :: held 1.094s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Created reservations ['f53469a2-5b22-4f68-8dee-6cd5fdc22dc6', '38e47854-75cc-46fa-b4a5-4f98dc71fe69', 'ed32ba9c-6373-422b-89c3-459f0d13c3e6', 'ed961a81-e87e-4e7b-8c6c-8e550d5895cd'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:38 devstack sudo[94764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:38 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:38 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.324s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:38 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Deleted volume successfully.
Nov 03 08:05:38 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008" returned: 0 in 0.798s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:38 devstack sudo[94769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008
Nov 03 08:05:38 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f68a9dc-e5cd-4bc7-abd3-9ab6ea7ee247 tempest-AttachVolumeTestJSON-833307314 None] Lock "cinder-6e1b215d-c220-49ec-bed4-d9bc72dfa81a-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:39 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380.666a808b-0b36-43c7-a579-6af78a59e008" returned: 0 in 0.408s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-666a808b-0b36-43c7-a579-6af78a59e008" released by "_delete_snapshot" :: held 2.415s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" released by "delete_snapshot" :: held 2.459s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:39 devstack cinder-volume[86851]: WARNING cinder.quota [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1478243622 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1478243622, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:05:39 devstack cinder-volume[86851]: WARNING cinder.quota [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1478243622 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1478243622, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:05:39 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Created reservations ['1e01d40f-1274-40e8-b44a-3cf2a6a5d15b', 'fc5c799b-b97c-4124-a9f9-b7fca35ca96c', '1fab3c68-847d-4220-be66-2126edade401', '4d42fd43-81b5-43d8-8df4-793e6cf2a02b'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:39 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] Created reservations ['a55d0409-c64d-4a27-aa14-a59abf694602', 'feda671e-59c8-48b4-af4b-9876b3104d81', '426e86cc-1ae4-4ad8-b51e-f51bf079297f', '382a20ea-1a6a-4ba9-bd60-e2834196addb'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:39 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e530152e-aa65-4f11-b3b0-50a1c2ab6c6d tempest-GroupSnapshotsTest-668021592 None] group_snapshot b9d6965a-8229-4e8b-b719-66832ddd3af1: deleted successfully
Nov 03 08:05:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-0d58d12f-280a-4f64-9137-a7b731908f95" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-0d58d12f-280a-4f64-9137-a7b731908f95" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:41 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38bd9d5-fcb1-4692-9810-14cec8e3d320]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:41 devstack sudo[94774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95
Nov 03 08:05:41 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:42 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95" returned: 0 in 0.677s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:42 devstack sudo[94781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95
Nov 03 08:05:42 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:42 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0d58d12f-280a-4f64-9137-a7b731908f95" returned: 0 in 0.638s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-0d58d12f-280a-4f64-9137-a7b731908f95" released by "delete_volume" :: held 1.472s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" acquired by "delete_volume" :: waited 0.052s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:43 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[25604a67-4950-4305-8c5d-d7a7556daf44]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:43 devstack sudo[94784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380
Nov 03 08:05:43 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:43 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" returned: 0 in 0.823s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:44 devstack sudo[94791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380
Nov 03 08:05:44 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:44 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" returned: 0 in 0.403s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-d9abd8f6-2a47-4e9c-bc4a-c091e3fe6380" released by "delete_volume" :: held 1.382s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:44 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Created reservations ['01c1b1ac-e3cb-4ea5-94c2-b4e971fda34f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:44 devstack cinder-volume[86851]: WARNING cinder.quota [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1478243622 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1478243622, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:05:44 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Created reservations ['9a185d45-7c6c-4592-a025-5c5439bdfabe', '787d5f88-3b92-47ea-a64c-457f2b6e85d0', 'c2e8f9cc-010f-4d9b-bf40-5b85f4638d8d', 'fded02b8-6bd9-4321-a8f2-1dc9caf66128'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:44 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4" returned: 0 in 7.943s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:44 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:05:44 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Converted 1024.00 MB image at 128.84 MB/s
Nov 03 08:05:44 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4 is being set with open permissions: ugo+rw
Nov 03 08:05:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:44 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Created reservations ['bebc7379-64c9-47e3-8ad2-b7f91bf7fbde', 'ab8b2644-b10a-495e-97a2-ee4ad9b23c68', '29b31227-5555-45fa-8e1c-b20b5e5bf927', 'f3343caf-976a-4f2e-b303-60f626525da6'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:44 devstack sudo[94794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4
Nov 03 08:05:44 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:45 devstack sudo[94796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:45 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:45 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4" returned: 0 in 0.265s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Lock "cinder-quobyte-b4b25997-d37f-40b4-8a21-c2b9421773d4" released by "_copy_volume_from_snapshot" :: held 9.142s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Acquiring lock "cinder-quobyte-09d0b9c6-0ddd-4aa9-9a34-a513d97775b7" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Lock "cinder-quobyte-09d0b9c6-0ddd-4aa9-9a34-a513d97775b7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Deleting offline snapshot 09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 of volume 37a4b1f5-e7b9-4020-a83b-a382e7538aea {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] snapshot_file for this snap is: volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a79092-8fae-42b3-88c2-bba6d2b7190d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:45 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.276s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:45 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5de9545f-3240-4531-9951-1450630a10be tempest-GroupSnapshotsTest-668021592 None] Delete group completed successfully.
Nov 03 08:05:45 devstack sudo[94799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7
Nov 03 08:05:45 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:45 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7" returned: 0 in 0.407s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aad654-896a-4e66-b9f0-488fe44d0e09]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:45 devstack sudo[94806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea
Nov 03 08:05:45 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:46 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-39889142-dd36-42ed-ab43-3f0b787aeaf2 tempest-GroupSnapshotsTest-668021592 None] Group tempest-GroupSnapshotsTest-Group-767022668: creating
Nov 03 08:05:46 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-39889142-dd36-42ed-ab43-3f0b787aeaf2 tempest-GroupSnapshotsTest-668021592 None] Group tempest-GroupSnapshotsTest-Group-767022668: created successfully
Nov 03 08:05:46 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-39889142-dd36-42ed-ab43-3f0b787aeaf2 tempest-GroupSnapshotsTest-668021592 None] Create group completed successfully.
Nov 03 08:05:46 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea" returned: 0 in 0.581s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:46 devstack sudo[94811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7
Nov 03 08:05:46 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:46 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7" returned: 0 in 0.354s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:46 devstack sudo[94817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7
Nov 03 08:05:46 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:46 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea.09d0b9c6-0ddd-4aa9-9a34-a513d97775b7" returned: 0 in 0.281s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Lock "cinder-quobyte-09d0b9c6-0ddd-4aa9-9a34-a513d97775b7" released by "_delete_snapshot" :: held 1.756s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.338s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.367s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-563994447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3d26ba-12c5-42df-a8ac-90c943dce18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04210aae8cbf431ca98040604576cb5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:34Z,use_quota=True,user_id='0a884cd851da44879c072c881a5b18ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Creating volume 0a3d26ba-12c5-42df-a8ac-90c943dce18c {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:47 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:47 devstack sudo[94820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c 1073741824
Nov 03 08:05:47 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93aaf58b-cdee-44c2-850d-77a29c76dcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b25997-d37f-40b4-8a21-c2b9421773d4', 'volume_size': 2, 'source_volid': '37a4b1f5-e7b9-4020-a83b-a382e7538aea', 'source_volstatus': 'available'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753f6ac7-4e5a-4033-a298-c15de3fceacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:47 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Volume volume-b4b25997-d37f-40b4-8a21-c2b9421773d4 (b4b25997-d37f-40b4-8a21-c2b9421773d4): created successfully
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753f6ac7-4e5a-4033-a298-c15de3fceacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Flow 'volume_create_manager' (f3be9e76-abd8-45e6-be7a-5fef88d3c858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:47 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4f07b972-0e45-4ebe-b0b9-47bc8bbbcc40 tempest-VolumesCloneTest-577896834 None] Created volume successfully.
Nov 03 08:05:47 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c 1073741824" returned: 0 in 0.533s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:47 devstack sudo[94826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c
Nov 03 08:05:47 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Flow 'volume_create_manager' (ba849a98-b54d-4f42-8dec-204e673f54aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec14901-4d3a-4dca-8bec-3c902b6caade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec14901-4d3a-4dca-8bec-3c902b6caade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2042637834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5cbff19f-1175-45ee-9afd-9a35042caf0e,host='devstack@QuobyteHD#QuobyteHD',id=1eb3b8ff-8577-4225-a8fc-955c5153fb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a9add118ca4d42b407e20591d3628b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:48Z,use_quota=True,user_id='9178a654037748238e5ad158a87a8691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e8b92-5e5b-4ca6-98b3-17cb49933911),volume_type_id=1f2e8b92-5e5b-4ca6-98b3-17cb49933911)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66994fe1-f02f-4513-bc61-ff2a3a58bcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66994fe1-f02f-4513-bc61-ff2a3a58bcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1077168-5a42-442a-9849-ae4faa05be72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1077168-5a42-442a-9849-ae4faa05be72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb3b8ff-8577-4225-a8fc-955c5153fb88', 'volume_name': 'volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe6e7b0-d5cf-49ac-a261-389df05a591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe6e7b0-d5cf-49ac-a261-389df05a591e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5f87cd-e5e2-466d-aaf6-bf3c53483061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:47 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Volume 1eb3b8ff-8577-4225-a8fc-955c5153fb88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88', 'volume_size': 1}
Nov 03 08:05:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:48 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c" returned: 0 in 0.448s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.146s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5cbff19f-1175-45ee-9afd-9a35042caf0e,created_at=2026-11-03T07:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2042637834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5cbff19f-1175-45ee-9afd-9a35042caf0e,host='devstack@QuobyteHD#QuobyteHD',id=1eb3b8ff-8577-4225-a8fc-955c5153fb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a9add118ca4d42b407e20591d3628b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:48Z,use_quota=True,user_id='9178a654037748238e5ad158a87a8691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2e8b92-5e5b-4ca6-98b3-17cb49933911),volume_type_id=1f2e8b92-5e5b-4ca6-98b3-17cb49933911)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Creating volume 1eb3b8ff-8577-4225-a8fc-955c5153fb88 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:48 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Acquiring lock "cinder-b4b25997-d37f-40b4-8a21-c2b9421773d4-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:48 devstack sudo[94829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 1073741824
Nov 03 08:05:48 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13742a9e-f8eb-4ea6-888a-1b8f13eeef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25963100-b10b-4f1d-b244-8fc164f3520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Lock "cinder-b4b25997-d37f-40b4-8a21-c2b9421773d4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:48 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Volume volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c (0a3d26ba-12c5-42df-a8ac-90c943dce18c): created successfully
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25963100-b10b-4f1d-b244-8fc164f3520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Flow 'volume_create_manager' (2a379121-b9c0-4a43-abc9-f60e5e3818a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:48 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-8dc14f6c-0de7-4387-b357-186083afcfd9 req-79c17938-2c85-4186-befb-c2b3e5accc06 tempest-VolumesSnapshotsTestJSON-516547459 None] Created volume successfully.
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Acquiring lock "cinder-quobyte-b4b25997-d37f-40b4-8a21-c2b9421773d4" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Lock "cinder-quobyte-b4b25997-d37f-40b4-8a21-c2b9421773d4" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91ae506-cb73-41fc-90f2-62799f3fd51f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:48 devstack sudo[94831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4
Nov 03 08:05:48 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:48 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 1073741824" returned: 0 in 0.606s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:48 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4" returned: 0 in 0.526s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:48 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88
Nov 03 08:05:48 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:48 devstack sudo[94842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4
Nov 03 08:05:48 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:49 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b4b25997-d37f-40b4-8a21-c2b9421773d4" returned: 0 in 0.282s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Lock "cinder-quobyte-b4b25997-d37f-40b4-8a21-c2b9421773d4" released by "delete_volume" :: held 0.879s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:49 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88" returned: 0 in 0.409s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.524s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5f87cd-e5e2-466d-aaf6-bf3c53483061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454f04a6-dfd0-4d5a-87b8-0d8408f6e72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Creating offline snapshot e412b7ff-e7b6-4ef0-9023-a4f1c04f215a of volume 0a3d26ba-12c5-42df-a8ac-90c943dce18c {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:05:49 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Volume volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 (1eb3b8ff-8577-4225-a8fc-955c5153fb88): created successfully
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454f04a6-dfd0-4d5a-87b8-0d8408f6e72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Flow 'volume_create_manager' (ba849a98-b54d-4f42-8dec-204e673f54aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65aa78d-a59e-48b5-9344-22497b1947f6]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Created reservations ['ec58b2eb-8765-4158-9729-d59ff2a712b9', '68c7a04a-d666-44e5-8e58-83ff1e248dea', '0bafa0fc-b432-42f7-b32c-2d96f7daeb39', 'a12205e0-d35e-4eb4-a87d-e7a3ec1d3ea9'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:49 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4be27f67-8fae-4ef1-8b5c-cc4f2546d479 tempest-GroupSnapshotsTest-668021592 None] Created volume successfully.
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:49 devstack sudo[94848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:49 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:49 devstack sudo[94847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c
Nov 03 08:05:49 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:49 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.277s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:49 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Deleted volume successfully.
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c" returned: 0 in 0.436s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:49 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:49 devstack sudo[94855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a 1G
Nov 03 08:05:49 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d669d5a3-c137-49bc-b0e8-39b1bda5daf5 tempest-VolumesCloneTest-577896834 None] Lock "cinder-b4b25997-d37f-40b4-8a21-c2b9421773d4-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:50 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a 1G" returned: 0 in 0.433s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:50 devstack sudo[94861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a
Nov 03 08:05:50 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Acquiring lock "cinder-37a4b1f5-e7b9-4020-a83b-a382e7538aea-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Lock "cinder-37a4b1f5-e7b9-4020-a83b-a382e7538aea-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Acquiring lock "cinder-quobyte-37a4b1f5-e7b9-4020-a83b-a382e7538aea" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Lock "cinder-quobyte-37a4b1f5-e7b9-4020-a83b-a382e7538aea" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:50 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a" returned: 0 in 0.429s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:50 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a is being set with open permissions: ugo+rw
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[81899514-bc9b-42aa-8da4-aec6950d3abd]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:50 devstack sudo[94868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a
Nov 03 08:05:50 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:50 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] GroupSnapshot d9d6736a-885b-44f4-9c60-c467efb1f5b3: creating.
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Group snapshot d9d6736a-885b-44f4-9c60-c467efb1f5b3: creating. {{(pid=86851) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:50 devstack sudo[94870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea
Nov 03 08:05:50 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:50 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a" returned: 0 in 0.307s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:50 devstack sudo[94873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.info
Nov 03 08:05:50 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:51 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea" returned: 0 in 0.432s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:51 devstack sudo[94878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea
Nov 03 08:05:51 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:51 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.info" returned: 0 in 0.271s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:51 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.info is being set with open permissions: ugo+rw
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:51 devstack sudo[94881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.info
Nov 03 08:05:51 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:51 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-37a4b1f5-e7b9-4020-a83b-a382e7538aea" returned: 0 in 0.303s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Lock "cinder-quobyte-37a4b1f5-e7b9-4020-a83b-a382e7538aea" released by "delete_volume" :: held 0.838s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Created reservations ['f3d41433-2d97-4fd4-a90c-b74ebc4c95db', '8adb56f7-2f7d-40fe-911e-82edb8f603f9', 'd6440967-9618-433b-b33a-f38188357ea0', '828e9bc2-11ee-410b-bfc5-b02ef8a85c60'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:51 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.info" returned: 0 in 0.286s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.310s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.770s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Creating offline snapshot d2101161-377f-4405-bbc6-22d5d0013939 of volume 1eb3b8ff-8577-4225-a8fc-955c5153fb88 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:05:51 devstack sudo[94885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:51 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:51 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-4babc445-c852-49ad-83c4-796d1a584785 req-1f4a99a0-185c-4d9d-a937-8d3fcfb9ae4b tempest-VolumesSnapshotsTestJSON-516547459 None] Create snapshot completed successfully
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea05f094-4154-4037-ba8a-558ba29f76fb]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:51 devstack sudo[94887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88
Nov 03 08:05:51 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:51 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.330s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:51 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Deleted volume successfully.
Nov 03 08:05:51 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-60f1ca12-972f-47dd-a71e-2a74f4123ac7 tempest-VolumesCloneTest-577896834 None] Lock "cinder-37a4b1f5-e7b9-4020-a83b-a382e7538aea-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:52 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88" returned: 0 in 0.467s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:52 devstack sudo[94893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939 1G
Nov 03 08:05:52 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Acquiring lock "cinder-e412b7ff-e7b6-4ef0-9023-a4f1c04f215a-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "cinder-e412b7ff-e7b6-4ef0-9023-a4f1c04f215a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Acquiring lock "cinder-quobyte-0a3d26ba-12c5-42df-a8ac-90c943dce18c" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "cinder-quobyte-0a3d26ba-12c5-42df-a8ac-90c943dce18c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Acquiring lock "cinder-quobyte-e412b7ff-e7b6-4ef0-9023-a4f1c04f215a" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "cinder-quobyte-e412b7ff-e7b6-4ef0-9023-a4f1c04f215a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Deleting offline snapshot e412b7ff-e7b6-4ef0-9023-a4f1c04f215a of volume 0a3d26ba-12c5-42df-a8ac-90c943dce18c {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:05:52 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] snapshot_file for this snap is: volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939 1G" returned: 0 in 0.588s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d31f69-a5c2-4144-8fcd-48729b05e363]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:52 devstack sudo[94898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939
Nov 03 08:05:52 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:52 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a
Nov 03 08:05:52 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:53 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939" returned: 0 in 0.376s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:53 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:53 devstack sudo[94906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939
Nov 03 08:05:53 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:53 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a" returned: 0 in 0.486s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bd8918-82b5-4bbb-b9ff-3ed281fdb650]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:53 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939" returned: 0 in 0.283s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:53 devstack sudo[94912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c
Nov 03 08:05:53 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:53 devstack sudo[94916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.info
Nov 03 08:05:53 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:53 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.info" returned: 0 in 0.305s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:53 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:53 devstack sudo[94922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.info
Nov 03 08:05:53 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:53 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c" returned: 0 in 0.542s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:53 devstack sudo[94924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a
Nov 03 08:05:53 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:54 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.info" returned: 0 in 0.464s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.654s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:54 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c91f373f-1e20-458d-9f3b-d3c645bdf8d1 tempest-GroupSnapshotsTest-668021592 None] group_snapshot d9d6736a-885b-44f4-9c60-c467efb1f5b3: created successfully
Nov 03 08:05:54 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a" returned: 0 in 0.567s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:54 devstack sudo[94931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a
Nov 03 08:05:54 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:54 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c.e412b7ff-e7b6-4ef0-9023-a4f1c04f215a" returned: 0 in 0.301s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "cinder-quobyte-e412b7ff-e7b6-4ef0-9023-a4f1c04f215a" released by "_delete_snapshot" :: held 2.092s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "cinder-quobyte-0a3d26ba-12c5-42df-a8ac-90c943dce18c" released by "delete_snapshot" :: held 2.128s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:54 devstack cinder-volume[86851]: DEBUG cinder.quota [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Created reservations ['6e3eba10-f06c-4997-88e5-3092cbf62761', '699c82b0-a95e-4aaf-8ac9-f3ec4b3b7294', 'da5899f3-0f5a-432a-89b0-4b049520419c', 'eee3d509-04e2-401e-8ecd-0a0c96d76f7c'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:54 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Delete snapshot completed successfully.
Nov 03 08:05:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-9ddeb9e1-f7cd-4511-aa83-daacc188e467 req-837d9ca6-be29-454b-b6a3-360106651db3 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "cinder-e412b7ff-e7b6-4ef0-9023-a4f1c04f215a-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] group_snapshot d9d6736a-885b-44f4-9c60-c467efb1f5b3: deleting
Nov 03 08:05:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] group_snapshot d9d6736a-885b-44f4-9c60-c467efb1f5b3: deleting {{(pid=86851) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 08:05:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-1eb3b8ff-8577-4225-a8fc-955c5153fb88" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-1eb3b8ff-8577-4225-a8fc-955c5153fb88" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-d2101161-377f-4405-bbc6-22d5d0013939" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-d2101161-377f-4405-bbc6-22d5d0013939" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Deleting offline snapshot d2101161-377f-4405-bbc6-22d5d0013939 of volume 1eb3b8ff-8577-4225-a8fc-955c5153fb88 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:05:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] snapshot_file for this snap is: volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:05:55 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a626727-69c7-474e-bbe7-1387f14be28f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:55 devstack sudo[94934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939
Nov 03 08:05:55 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Acquiring lock "cinder-0a3d26ba-12c5-42df-a8ac-90c943dce18c-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "cinder-0a3d26ba-12c5-42df-a8ac-90c943dce18c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Acquiring lock "cinder-quobyte-0a3d26ba-12c5-42df-a8ac-90c943dce18c" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:56 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939" returned: 0 in 0.646s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "cinder-quobyte-0a3d26ba-12c5-42df-a8ac-90c943dce18c" acquired by "delete_volume" :: waited 0.065s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cc821f-e65e-412f-b733-3a6d98e420bd]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8471e1-09fd-47d1-accb-10c8ade13719]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:56 devstack sudo[94939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88
Nov 03 08:05:56 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:56 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c
Nov 03 08:05:56 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:56 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:56 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c" returned: 0 in 0.508s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88" returned: 0 in 0.543s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:56 devstack sudo[94950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939
Nov 03 08:05:56 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:56 devstack sudo[94949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c
Nov 03 08:05:56 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:57 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939" returned: 0 in 0.481s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:57 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0a3d26ba-12c5-42df-a8ac-90c943dce18c" returned: 0 in 0.510s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:57 devstack sudo[94957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939
Nov 03 08:05:57 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "cinder-quobyte-0a3d26ba-12c5-42df-a8ac-90c943dce18c" released by "delete_volume" :: held 1.138s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=175,cinder:UPDATE=184,cinder:INSERT=44,cinder:DELETE=10 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Flow 'volume_create_manager' (10b1ee06-3f6d-4901-8046-d96d9cf53f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8933d6c1-041f-41d8-bd2c-2c5912bdacde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.quota [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Created reservations ['e7a2bd89-49df-4213-8a97-564c8d43ded2', '8361036f-1b72-483a-83fd-771a1e306b02', '1907d835-9f65-4597-836b-85cadde48da6', '0b84114a-4e70-4189-b06c-a9babd3af007'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=181,cinder:SELECT=170,cinder:INSERT=44,cinder:DELETE=10 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8933d6c1-041f-41d8-bd2c-2c5912bdacde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1152864468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4455d2da-8031-4937-bcbd-beccb52c9a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9edeaae50f4a2f99adfc6d7d03809a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:57Z,use_quota=True,user_id='b8276372d6a145e29cdb38c50f6f7bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0395a07e-4562-4426-aa91-ae50f88bf963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0395a07e-4562-4426-aa91-ae50f88bf963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2faad7-1b9d-430a-aa6d-6b3796380aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2faad7-1b9d-430a-aa6d-6b3796380aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4455d2da-8031-4937-bcbd-beccb52c9a34', 'volume_name': 'volume-4455d2da-8031-4937-bcbd-beccb52c9a34', 'volume_size': 2}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057c7bd2-4fb6-4d91-8720-53fe6f3079cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057c7bd2-4fb6-4d91-8720-53fe6f3079cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67faf123-00a2-4b29-a07d-ea451432658f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:57 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Volume 4455d2da-8031-4937-bcbd-beccb52c9a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4455d2da-8031-4937-bcbd-beccb52c9a34', 'volume_size': 2}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1152864468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4455d2da-8031-4937-bcbd-beccb52c9a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9edeaae50f4a2f99adfc6d7d03809a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:05:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:05:57Z,use_quota=True,user_id='b8276372d6a145e29cdb38c50f6f7bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Creating volume 4455d2da-8031-4937-bcbd-beccb52c9a34 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:05:57 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34 2147483648 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:57 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88.d2101161-377f-4405-bbc6-22d5d0013939" returned: 0 in 0.341s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:57 devstack sudo[94960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34 2147483648
Nov 03 08:05:57 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-d2101161-377f-4405-bbc6-22d5d0013939" released by "_delete_snapshot" :: held 2.240s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-1eb3b8ff-8577-4225-a8fc-955c5153fb88" released by "delete_snapshot" :: held 2.295s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:57 devstack sudo[94962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:05:57 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:57 devstack cinder-volume[86851]: WARNING cinder.quota [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-913643941 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-913643941, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:05:57 devstack cinder-volume[86851]: WARNING cinder.quota [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-913643941 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-913643941, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:05:57 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] Created reservations ['67483505-6893-4917-9c4c-138c0e48b9d5', '34dbe125-b09f-46dd-8b4a-1a84a3db8598', '69a4bb5b-1cda-4916-8165-5af9e3363422', '42eda6dc-01f0-4999-8b13-5148e5f5ce21'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:05:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e1749b99-bb8e-4c72-a1b3-df7c5d488992 tempest-GroupSnapshotsTest-668021592 None] group_snapshot d9d6736a-885b-44f4-9c60-c467efb1f5b3: deleted successfully
Nov 03 08:05:58 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.325s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG cinder.manager [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:05:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Deleted volume successfully.
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-4d575b3f-abe2-4387-936c-1e6d8202a114 req-75e9b513-6628-4ea5-8da7-9a5bd5a27de5 tempest-VolumesSnapshotsTestJSON-516547459 None] Lock "cinder-0a3d26ba-12c5-42df-a8ac-90c943dce18c-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:05:58 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34 2147483648" returned: 0 in 0.632s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:58 devstack sudo[94969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34
Nov 03 08:05:58 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:58 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34" returned: 0 in 0.363s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67faf123-00a2-4b29-a07d-ea451432658f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4455d2da-8031-4937-bcbd-beccb52c9a34', 'volume_size': 2}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe521e3-49b5-4f7e-9344-6414750ad762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:05:58 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Volume volume-4455d2da-8031-4937-bcbd-beccb52c9a34 (4455d2da-8031-4937-bcbd-beccb52c9a34): created successfully
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe521e3-49b5-4f7e-9344-6414750ad762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:05:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Flow 'volume_create_manager' (10b1ee06-3f6d-4901-8046-d96d9cf53f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:05:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-eba7a9f8-33c3-4259-bb80-e0b4b3f8467b tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Created volume successfully.
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "cinder-quobyte-1eb3b8ff-8577-4225-a8fc-955c5153fb88" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-1eb3b8ff-8577-4225-a8fc-955c5153fb88" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad65b191-60af-449e-afab-36a117fc99f3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:59 devstack sudo[94972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88
Nov 03 08:05:59 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Creating offline snapshot b85f5de9-21a6-4673-8088-cfa007b6c785 of volume 4455d2da-8031-4937-bcbd-beccb52c9a34 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5907fd4c-82a4-4177-a3df-f8e3b5318632]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:59 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88" returned: 0 in 0.557s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:05:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:05:59 devstack sudo[94976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34
Nov 03 08:05:59 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:05:59 devstack sudo[94978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88
Nov 03 08:05:59 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:00 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1eb3b8ff-8577-4225-a8fc-955c5153fb88" returned: 0 in 0.317s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:00 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34" returned: 0 in 0.441s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785 2G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Lock "cinder-quobyte-1eb3b8ff-8577-4225-a8fc-955c5153fb88" released by "delete_volume" :: held 0.977s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:00 devstack sudo[94985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785 2G
Nov 03 08:06:00 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Created reservations ['9ef597bf-ab25-4f25-bc4a-ce3223e6cecb'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:00 devstack cinder-volume[86851]: WARNING cinder.quota [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-913643941 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-913643941, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Created reservations ['e33e05f6-b802-4de8-9e4b-ab79ae83e91b', '085ab65e-c1f2-4d8a-9da6-dcfbc6f2f278', '659b3762-1973-4030-afcb-821a4a732e5f', 'd6310ab7-bdf4-44dd-b133-53a7079056be'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:00 devstack sudo[94990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:06:00 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:00 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785 2G" returned: 0 in 0.586s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4455d2da-8031-4937-bcbd-beccb52c9a34 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:00 devstack sudo[94994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4455d2da-8031-4937-bcbd-beccb52c9a34 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785
Nov 03 08:06:00 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:01 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.479s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:01 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:06:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-87f315e3-3e09-4fcd-b16d-0b5ac3525c0d tempest-GroupSnapshotsTest-668021592 None] Delete group completed successfully.
Nov 03 08:06:01 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4455d2da-8031-4937-bcbd-beccb52c9a34 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785" returned: 0 in 0.439s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:01 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785 is being set with open permissions: ugo+rw
Nov 03 08:06:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:01 devstack sudo[95000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785
Nov 03 08:06:01 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:01 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785" returned: 0 in 0.347s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:01 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.info
Nov 03 08:06:01 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:02 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.info" returned: 0 in 0.342s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:02 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.info is being set with open permissions: ugo+rw
Nov 03 08:06:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:02 devstack sudo[95006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.info
Nov 03 08:06:02 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:02 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.info" returned: 0 in 0.314s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d497a711-508a-4c1e-88a3-d9020d40dee1 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Create snapshot completed successfully
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Acquiring lock "cinder-b85f5de9-21a6-4673-8088-cfa007b6c785-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "cinder-b85f5de9-21a6-4673-8088-cfa007b6c785-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Acquiring lock "cinder-quobyte-4455d2da-8031-4937-bcbd-beccb52c9a34" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "cinder-quobyte-4455d2da-8031-4937-bcbd-beccb52c9a34" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Acquiring lock "cinder-quobyte-b85f5de9-21a6-4673-8088-cfa007b6c785" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "cinder-quobyte-b85f5de9-21a6-4673-8088-cfa007b6c785" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Deleting offline snapshot b85f5de9-21a6-4673-8088-cfa007b6c785 of volume 4455d2da-8031-4937-bcbd-beccb52c9a34 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] snapshot_file for this snap is: volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf023a91-5917-4757-a602-5c42681cd8c3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:03 devstack sudo[95009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:06:03 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:03 devstack sudo[95010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785
Nov 03 08:06:03 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:03 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.355s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:06:03 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785" returned: 0 in 0.509s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4455d2da-8031-4937-bcbd-beccb52c9a34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb1a235-356c-4ee2-8771-86edee78cd63]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:03 devstack sudo[95019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34
Nov 03 08:06:03 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:04 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34" returned: 0 in 0.540s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:04 devstack sudo[95027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785
Nov 03 08:06:04 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:04 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785" returned: 0 in 0.415s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:04 devstack sudo[95033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785
Nov 03 08:06:04 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9bfa967e-66a9-40cc-ac8b-c886dcc8d3bb tempest-BackendsCapabilitiesAdminTestsJSON-1004696173 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7431602478027, 'free_capacity_gb': 1773.7431602478027, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86851) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 08:06:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc684146-0069-4f58-ac95-97d1a67d4ebd tempest-BackendsCapabilitiesAdminTestsJSON-1004696173 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7431602478027, 'free_capacity_gb': 1773.7431602478027, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86851) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 08:06:05 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34.b85f5de9-21a6-4673-8088-cfa007b6c785" returned: 0 in 0.368s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "cinder-quobyte-b85f5de9-21a6-4673-8088-cfa007b6c785" released by "_delete_snapshot" :: held 2.049s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "cinder-quobyte-4455d2da-8031-4937-bcbd-beccb52c9a34" released by "delete_snapshot" :: held 2.085s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:05 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Created reservations ['ea1eb75f-b115-4fd7-bdfd-3c8b108885ec', '8589c25d-b890-49ec-9fd6-146b799cf233', 'b8858e29-21cc-4649-8b66-4c7961df3d4a', '4f749623-e9ce-4367-960c-03d24c35debc'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:05 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Delete snapshot completed successfully.
Nov 03 08:06:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-604c424f-4842-4aaf-b6fb-778438a48f89 tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "cinder-b85f5de9-21a6-4673-8088-cfa007b6c785-delete_snapshot" released by "delete_snapshot" :: held 2.261s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Acquiring lock "cinder-4455d2da-8031-4937-bcbd-beccb52c9a34-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "cinder-4455d2da-8031-4937-bcbd-beccb52c9a34-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Acquiring lock "cinder-quobyte-4455d2da-8031-4937-bcbd-beccb52c9a34" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "cinder-quobyte-4455d2da-8031-4937-bcbd-beccb52c9a34" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:06 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc88d356-841d-437e-a6cb-d6504a2017a7]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:06 devstack sudo[95038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34
Nov 03 08:06:06 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:07 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34" returned: 0 in 0.591s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:07 devstack sudo[95055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34
Nov 03 08:06:07 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:07 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4455d2da-8031-4937-bcbd-beccb52c9a34" returned: 0 in 0.496s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "cinder-quobyte-4455d2da-8031-4937-bcbd-beccb52c9a34" released by "delete_volume" :: held 1.188s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Created reservations ['c7202910-4aad-422d-b740-c3a1fb0169e7', 'c53fd514-97a7-455f-8b83-e57680bb8b7b', 'da74bfa6-f26d-44e0-a641-afb141f1fab3', '0969ea21-72ff-4de4-a1ff-30831ac0d07b'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:07 devstack sudo[95064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:06:07 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:08 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.404s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:08 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:06:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Deleted volume successfully.
Nov 03 08:06:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-07b582d8-a07e-4df2-a68c-8b60afae636c tempest-VolumesSnapshotNegativeTestJSON-1092589624 None] Lock "cinder-4455d2da-8031-4937-bcbd-beccb52c9a34-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7c011c8d-7219-41dd-a829-8d3702e732c0 tempest-GroupSnapshotsV319Test-1301622231 None] Group tempest-GroupSnapshotsV319Test-Group-1350258111: creating
Nov 03 08:06:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7c011c8d-7219-41dd-a829-8d3702e732c0 tempest-GroupSnapshotsV319Test-1301622231 None] Group tempest-GroupSnapshotsV319Test-Group-1350258111: created successfully
Nov 03 08:06:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7c011c8d-7219-41dd-a829-8d3702e732c0 tempest-GroupSnapshotsV319Test-1301622231 None] Create group completed successfully.
Nov 03 08:06:11 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Flow 'volume_create_manager' (da475bfe-47a4-40d4-9a27-e57ef19e3203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1861a12c-a4f1-4a71-ac7f-0bbeacd867d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1861a12c-a4f1-4a71-ac7f-0bbeacd867d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-672439207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0d7f032-1627-4495-ac9e-6caed3a798e0,host='devstack@QuobyteHD#QuobyteHD',id=e0670d75-e090-4133-aa8b-2dbc54c1a315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60632ed1b7a84beca0a794c4d113e0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:12Z,use_quota=True,user_id='1cd300ca307c44f39e694178399f0948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(944afc73-61de-423e-ac6c-2284729fd298),volume_type_id=944afc73-61de-423e-ac6c-2284729fd298)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4363ca-d12d-4f62-9be7-019feae36fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4363ca-d12d-4f62-9be7-019feae36fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc321b8-812e-484c-b95e-c8e75ee59298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc321b8-812e-484c-b95e-c8e75ee59298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0670d75-e090-4133-aa8b-2dbc54c1a315', 'volume_name': 'volume-e0670d75-e090-4133-aa8b-2dbc54c1a315', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1083ec-529b-4bb1-ab8b-8c1c1527fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1083ec-529b-4bb1-ab8b-8c1c1527fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87538c2a-2589-4739-8c50-56e2cb04331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:12 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Volume e0670d75-e090-4133-aa8b-2dbc54c1a315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0670d75-e090-4133-aa8b-2dbc54c1a315', 'volume_size': 1}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c0d7f032-1627-4495-ac9e-6caed3a798e0,created_at=2026-11-03T07:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-672439207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0d7f032-1627-4495-ac9e-6caed3a798e0,host='devstack@QuobyteHD#QuobyteHD',id=e0670d75-e090-4133-aa8b-2dbc54c1a315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60632ed1b7a84beca0a794c4d113e0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:12Z,use_quota=True,user_id='1cd300ca307c44f39e694178399f0948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(944afc73-61de-423e-ac6c-2284729fd298),volume_type_id=944afc73-61de-423e-ac6c-2284729fd298)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Creating volume e0670d75-e090-4133-aa8b-2dbc54c1a315 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:06:12 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:12 devstack sudo[95139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 1073741824
Nov 03 08:06:12 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:12 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 1073741824" returned: 0 in 0.745s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:12 devstack sudo[95146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315
Nov 03 08:06:12 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:13 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315" returned: 0 in 0.346s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:06:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87538c2a-2589-4739-8c50-56e2cb04331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0670d75-e090-4133-aa8b-2dbc54c1a315', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8ba235-54df-447b-96b4-fca236e8c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Volume volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 (e0670d75-e090-4133-aa8b-2dbc54c1a315): created successfully
Nov 03 08:06:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8ba235-54df-447b-96b4-fca236e8c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Flow 'volume_create_manager' (da475bfe-47a4-40d4-9a27-e57ef19e3203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-61bdb8ad-faa7-49b7-9d29-1fe51237f644 tempest-GroupSnapshotsV319Test-1301622231 None] Created volume successfully.
Nov 03 08:06:15 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] GroupSnapshot 19ef36fd-9264-455d-acb4-c1061360e14d: creating.
Nov 03 08:06:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Group snapshot 19ef36fd-9264-455d-acb4-c1061360e14d: creating. {{(pid=86851) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 08:06:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Creating offline snapshot 5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 of volume e0670d75-e090-4133-aa8b-2dbc54c1a315 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:06:15 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a845b73-30ed-47e3-8258-28cee8a39355]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:15 devstack sudo[95150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315
Nov 03 08:06:15 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:15 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315" returned: 0 in 0.694s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:16 devstack sudo[95157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 1G
Nov 03 08:06:16 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:16 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 1G" returned: 0 in 0.653s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:16 devstack sudo[95164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390
Nov 03 08:06:16 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:17 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390" returned: 0 in 0.438s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:17 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:06:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:17 devstack sudo[95170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390
Nov 03 08:06:17 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:17 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390" returned: 0 in 0.505s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:17 devstack sudo[95185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.info
Nov 03 08:06:17 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:18 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.info" returned: 0 in 0.435s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:18 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:06:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:18 devstack sudo[95192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.info
Nov 03 08:06:18 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:18 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.info" returned: 0 in 0.489s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.403s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-89c85a85-9d9a-480d-bdaa-8dfa25a2bc29 tempest-GroupSnapshotsV319Test-1301622231 None] group_snapshot 19ef36fd-9264-455d-acb4-c1061360e14d: created successfully
Nov 03 08:06:20 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] group_snapshot 19ef36fd-9264-455d-acb4-c1061360e14d: deleting
Nov 03 08:06:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] group_snapshot 19ef36fd-9264-455d-acb4-c1061360e14d: deleting {{(pid=86851) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 08:06:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Acquiring lock "cinder-quobyte-e0670d75-e090-4133-aa8b-2dbc54c1a315" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Lock "cinder-quobyte-e0670d75-e090-4133-aa8b-2dbc54c1a315" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Acquiring lock "cinder-quobyte-5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Lock "cinder-quobyte-5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Deleting offline snapshot 5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 of volume e0670d75-e090-4133-aa8b-2dbc54c1a315 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:06:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] snapshot_file for this snap is: volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:06:20 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4d7e32-71f7-4267-9597-3536b75fd83f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:20 devstack sudo[95197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390
Nov 03 08:06:20 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:21 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390" returned: 0 in 0.719s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0670d75-e090-4133-aa8b-2dbc54c1a315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:06:21 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[419ffbe8-965e-4677-a723-f8e949e3a28c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:21 devstack sudo[95202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315
Nov 03 08:06:21 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:21 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315" returned: 0 in 0.505s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:22 devstack sudo[95208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390
Nov 03 08:06:22 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:22 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390" returned: 0 in 0.437s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:22 devstack sudo[95213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390
Nov 03 08:06:22 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:22 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315.5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390" returned: 0 in 0.332s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Lock "cinder-quobyte-5de2aa8e-62ca-4d6d-b4e6-f3e9a823b390" released by "_delete_snapshot" :: held 2.182s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Lock "cinder-quobyte-e0670d75-e090-4133-aa8b-2dbc54c1a315" released by "delete_snapshot" :: held 2.220s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:22 devstack cinder-volume[86851]: WARNING cinder.quota [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1581338609 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1581338609, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:06:22 devstack cinder-volume[86851]: WARNING cinder.quota [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1581338609 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1581338609, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:06:22 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] Created reservations ['8687d02c-e259-418d-86e0-f88355851ff3', '34916f8a-9bf3-4bc3-9222-f702ffed1087', '6748a90c-a533-4523-bb99-f1fd6bd918a9', '1b18348f-bccf-43dd-a1b4-70d95f154ae2'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0b30c029-7b76-48d8-9da1-ae750a7f67d0 tempest-GroupSnapshotsV319Test-1301622231 None] group_snapshot 19ef36fd-9264-455d-acb4-c1061360e14d: deleted successfully
Nov 03 08:06:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Acquiring lock "cinder-quobyte-e0670d75-e090-4133-aa8b-2dbc54c1a315" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Lock "cinder-quobyte-e0670d75-e090-4133-aa8b-2dbc54c1a315" acquired by "delete_volume" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:24 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8c92a2-b729-4b8c-900a-59830ded745e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:24 devstack sudo[95217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315
Nov 03 08:06:24 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:25 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315" returned: 0 in 0.592s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:25 devstack sudo[95239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315
Nov 03 08:06:25 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:25 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e0670d75-e090-4133-aa8b-2dbc54c1a315" returned: 0 in 0.298s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Lock "cinder-quobyte-e0670d75-e090-4133-aa8b-2dbc54c1a315" released by "delete_volume" :: held 1.000s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Created reservations ['6b1d2b71-57c3-4fcd-8f61-89fbbcbfedb6'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:25 devstack cinder-volume[86851]: WARNING cinder.quota [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1581338609 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1581338609, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Created reservations ['e7f9e535-e34c-4d07-ba69-cb98abf2d6d1', '8c01598a-060c-464b-8798-b7a9c8b44a45', '41b3df2c-9c37-4531-9c58-ac5cea7c50eb', '1d271878-e7f9-460b-ba0a-37cc4ebc7bda'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:25 devstack sudo[95242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:06:25 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:25 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.338s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:25 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:06:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4ec497f7-1422-46ca-afdd-1bc87ccbf11a tempest-GroupSnapshotsV319Test-1301622231 None] Delete group completed successfully.
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=60,cinder:SELECT=63,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:INSERT=19,cinder:UPDATE=69,cinder:SELECT=46,cinder:DELETE=4 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Flow 'volume_create_manager' (56d5e895-0184-4194-a921-74ac62573269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8836d03-3eb2-4c6e-b4dc-7f5ef6c52b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8836d03-3eb2-4c6e-b4dc-7f5ef6c52b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1982275240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03e2c19-ff3f-4b38-84f5-ae0710723c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9016c30b1424dcdadaf86266a28ca8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:36Z,use_quota=True,user_id='ad93be4542a7477391b67a7a4194e2c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aefd23a-f220-4f5f-839c-797befa987aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aefd23a-f220-4f5f-839c-797befa987aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9367a4-5ea9-4cd5-a618-859d2cb8b8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9367a4-5ea9-4cd5-a618-859d2cb8b8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03e2c19-ff3f-4b38-84f5-ae0710723c82', 'volume_name': 'volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390c20b0-f342-4c18-938f-98ebea347832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390c20b0-f342-4c18-938f-98ebea347832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c9c86e-2e92-40f8-9658-2e51b2bee9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:35 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Volume d03e2c19-ff3f-4b38-84f5-ae0710723c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82', 'volume_size': 1}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1982275240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03e2c19-ff3f-4b38-84f5-ae0710723c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9016c30b1424dcdadaf86266a28ca8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:36Z,use_quota=True,user_id='ad93be4542a7477391b67a7a4194e2c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Creating volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:06:35 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:06:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:35 devstack sudo[95284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 1073741824
Nov 03 08:06:35 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:36 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 1073741824" returned: 0 in 0.688s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:36 devstack sudo[95293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82
Nov 03 08:06:36 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:37 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82" returned: 0 in 0.561s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Flow 'volume_create_manager' (af590c2d-8f10-4855-96cb-048efa312e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130b5326-350e-4518-99c5-abd008cfa0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c9c86e-2e92-40f8-9658-2e51b2bee9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7436eb-aa12-44d5-8118-e66841ce4c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130b5326-350e-4518-99c5-abd008cfa0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1917004886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aed085f9cf4550923d1e72500cd167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:37Z,use_quota=True,user_id='18ac9ad65aa44dae92bb70f4e039dcd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203b5a1d-2c94-4c86-aa91-51d9b219291e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203b5a1d-2c94-4c86-aa91-51d9b219291e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a7c440-07fa-47f0-a85e-6fa1f543c1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a7c440-07fa-47f0-a85e-6fa1f543c1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986', 'volume_name': 'volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519b7626-6358-474e-a4b9-746ba426646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519b7626-6358-474e-a4b9-746ba426646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f30216a-736f-402f-8e79-805f5367514b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:37 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Volume 8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986', 'volume_size': 1}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1917004886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aed085f9cf4550923d1e72500cd167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:37Z,use_quota=True,user_id='18ac9ad65aa44dae92bb70f4e039dcd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Creating volume 8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:06:37 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:37 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Volume volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 (d03e2c19-ff3f-4b38-84f5-ae0710723c82): created successfully
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7436eb-aa12-44d5-8118-e66841ce4c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:37 devstack sudo[95296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986 1073741824
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Flow 'volume_create_manager' (56d5e895-0184-4194-a921-74ac62573269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:37 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:37 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ee097b46-2cc8-40b0-b48d-d7a7eb42d008 tempest-SnapshotsActionsTest-2099954759 None] Created volume successfully.
Nov 03 08:06:37 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986 1073741824" returned: 0 in 0.549s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:37 devstack sudo[95302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986
Nov 03 08:06:37 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:38 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986" returned: 0 in 0.323s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f30216a-736f-402f-8e79-805f5367514b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dd71a5-49f9-4190-b65e-2fdbe2c4d557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:38 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Volume volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986 (8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986): created successfully
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dd71a5-49f9-4190-b65e-2fdbe2c4d557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Flow 'volume_create_manager' (af590c2d-8f10-4855-96cb-048efa312e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:38 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5a579020-1d42-4047-898f-b96ca21f0c6a tempest-AttachVolumeNegativeTest-395788549 None] Created volume successfully.
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Creating offline snapshot 23bf9a06-5c45-45a0-9747-dbc8736c85e8 of volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fbe985-b76a-4e3c-b25f-e8930bc649d5]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:38 devstack sudo[95305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82
Nov 03 08:06:38 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:39 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82" returned: 0 in 0.445s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:39 devstack sudo[95310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 1G
Nov 03 08:06:39 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:39 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 1G" returned: 0 in 0.578s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:39 devstack sudo[95319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:06:39 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:40 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.541s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:40 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 is being set with open permissions: ugo+rw
Nov 03 08:06:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:40 devstack sudo[95333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:06:40 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-b9c30416-1370-4784-8da8-dc190c331e59 req-35703a73-953a-498f-8f27-864e9ee1baef tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:40 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.276s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:40 devstack sudo[95338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.info
Nov 03 08:06:40 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:40 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.info" returned: 0 in 0.269s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:40 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.info is being set with open permissions: ugo+rw
Nov 03 08:06:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:40 devstack sudo[95341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.info
Nov 03 08:06:40 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:41 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.info" returned: 0 in 0.272s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-b9c30416-1370-4784-8da8-dc190c331e59 req-35703a73-953a-498f-8f27-864e9ee1baef tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.676s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-b9c30416-1370-4784-8da8-dc190c331e59 req-35703a73-953a-498f-8f27-864e9ee1baef tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:41 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ef815264-1d29-4036-a6d1-f5fd95f0ee46 tempest-SnapshotsActionsTest-2099954759 None] Create snapshot completed successfully
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-b9c30416-1370-4784-8da8-dc190c331e59 req-35703a73-953a-498f-8f27-864e9ee1baef tempest-AttachVolumeNegativeTest-395788549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e31737ff-6c1e-4f0a-a8d8-3c1bfc26770e', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:06:41 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-b9c30416-1370-4784-8da8-dc190c331e59 req-35703a73-953a-498f-8f27-864e9ee1baef tempest-AttachVolumeNegativeTest-395788549 None] attachment_update completed successfully.
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Flow 'volume_create_manager' (fde13831-b6ae-4981-8419-148fabda0462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ce8884-7d07-4a8b-81b3-d1d9f8883681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ce8884-7d07-4a8b-81b3-d1d9f8883681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-571791619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe2a0aa-716d-4f2f-9306-9ce64261056d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad40692b115406abdb1d3afa49f548c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:41Z,use_quota=True,user_id='3f94b126a66e4c948a1e68140327728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd75c60b-0689-41eb-b58d-843b15dd88d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd75c60b-0689-41eb-b58d-843b15dd88d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85287f9c-6e4f-409e-8641-960a0a80a88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85287f9c-6e4f-409e-8641-960a0a80a88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe2a0aa-716d-4f2f-9306-9ce64261056d', 'volume_name': 'volume-abe2a0aa-716d-4f2f-9306-9ce64261056d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bce2c3f-0bc4-45f8-94b9-c421a0dbe03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bce2c3f-0bc4-45f8-94b9-c421a0dbe03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9a7706-8fd5-464d-9941-c2dfafde4c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:41 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Volume abe2a0aa-716d-4f2f-9306-9ce64261056d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe2a0aa-716d-4f2f-9306-9ce64261056d', 'volume_size': 1}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-571791619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe2a0aa-716d-4f2f-9306-9ce64261056d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad40692b115406abdb1d3afa49f548c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:41Z,use_quota=True,user_id='3f94b126a66e4c948a1e68140327728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Creating volume abe2a0aa-716d-4f2f-9306-9ce64261056d {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:06:41 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:06:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:41 devstack sudo[95345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d 1073741824
Nov 03 08:06:41 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:42 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d 1073741824" returned: 0 in 0.781s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Flow 'volume_create_manager' (72b234c7-732f-40e8-b52c-b2a38c50f9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f56ed3c-761e-466f-9694-7384841968f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f56ed3c-761e-466f-9694-7384841968f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1097817412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382b3d0b-7578-4c02-8487-5cf56ad23827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad40692b115406abdb1d3afa49f548c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:42Z,use_quota=True,user_id='3f94b126a66e4c948a1e68140327728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291042c7-6ff0-4f67-a78c-40e69468b15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291042c7-6ff0-4f67-a78c-40e69468b15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa513fe-ee32-42a0-8a37-d49fcfd6f0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa513fe-ee32-42a0-8a37-d49fcfd6f0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '382b3d0b-7578-4c02-8487-5cf56ad23827', 'volume_name': 'volume-382b3d0b-7578-4c02-8487-5cf56ad23827', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96fb69a-794a-46ab-a6b5-4e4e9668418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96fb69a-794a-46ab-a6b5-4e4e9668418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f18406b-6d40-4ff1-92da-6333fc86cf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Volume 382b3d0b-7578-4c02-8487-5cf56ad23827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-382b3d0b-7578-4c02-8487-5cf56ad23827', 'volume_size': 1}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:42 devstack sudo[95767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d
Nov 03 08:06:42 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:42 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d" returned: 0 in 0.424s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1097817412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382b3d0b-7578-4c02-8487-5cf56ad23827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad40692b115406abdb1d3afa49f548c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:42Z,use_quota=True,user_id='3f94b126a66e4c948a1e68140327728c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Creating volume 382b3d0b-7578-4c02-8487-5cf56ad23827 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:06:42 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9a7706-8fd5-464d-9941-c2dfafde4c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe2a0aa-716d-4f2f-9306-9ce64261056d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:42 devstack sudo[95770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827 1073741824
Nov 03 08:06:42 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05447df-36a0-4955-82cc-bf4f6cb56bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Volume volume-abe2a0aa-716d-4f2f-9306-9ce64261056d (abe2a0aa-716d-4f2f-9306-9ce64261056d): created successfully
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05447df-36a0-4955-82cc-bf4f6cb56bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Flow 'volume_create_manager' (fde13831-b6ae-4981-8419-148fabda0462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:42 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3510b367-2489-46ce-aeef-47fc124fba96 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Created volume successfully.
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Flow 'volume_create_manager' (aaebfb08-ad24-49ed-93a4-31f9d5b67c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1aadd6-2c5f-41a4-b25e-34a64edfd52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1aadd6-2c5f-41a4-b25e-34a64edfd52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-771113992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63cfe3b-4389-4bc9-80ae-648ab082019e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b01a3e07c441fdb2cf4c4fe291311b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:43Z,use_quota=True,user_id='dd237867da72487aa97b127a2e4495b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217927e6-5677-4e25-8170-afc44af3a6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217927e6-5677-4e25-8170-afc44af3a6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1d3008-1841-4770-90e9-c3511bc9ac7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1d3008-1841-4770-90e9-c3511bc9ac7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63cfe3b-4389-4bc9-80ae-648ab082019e', 'volume_name': 'volume-d63cfe3b-4389-4bc9-80ae-648ab082019e', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8b657a-c7d7-4590-b0ee-e25cecd2dcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8b657a-c7d7-4590-b0ee-e25cecd2dcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccf2682-edf4-42f0-8a10-0e208abacc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:42 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Volume d63cfe3b-4389-4bc9-80ae-648ab082019e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63cfe3b-4389-4bc9-80ae-648ab082019e', 'volume_size': 1}
Nov 03 08:06:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:43 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827 1073741824" returned: 0 in 0.577s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:43 devstack sudo[95776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827
Nov 03 08:06:43 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:43 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827" returned: 0 in 0.275s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.217s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] Creating offline snapshot 93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 of volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f18406b-6d40-4ff1-92da-6333fc86cf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-382b3d0b-7578-4c02-8487-5cf56ad23827', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5a2a5d-c4c7-4989-9d59-c9aa14e524cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[531c13eb-abbf-4ad5-abca-de9557ef7ff6]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:43 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Volume volume-382b3d0b-7578-4c02-8487-5cf56ad23827 (382b3d0b-7578-4c02-8487-5cf56ad23827): created successfully
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5a2a5d-c4c7-4989-9d59-c9aa14e524cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Flow 'volume_create_manager' (72b234c7-732f-40e8-b52c-b2a38c50f9fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ba604b99-2779-4c45-b598-9ffabbd5f4f0 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Created volume successfully.
Nov 03 08:06:43 devstack sudo[95780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:06:43 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:44 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.407s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:06:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:44 devstack sudo[95785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 1G
Nov 03 08:06:44 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:44 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 1G" returned: 0 in 0.510s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:44 devstack sudo[95791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3
Nov 03 08:06:44 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:45 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3" returned: 0 in 0.376s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:45 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 is being set with open permissions: ugo+rw
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:45 devstack sudo[95796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3
Nov 03 08:06:45 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:45 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3" returned: 0 in 0.250s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.704s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.354s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-771113992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63cfe3b-4389-4bc9-80ae-648ab082019e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b01a3e07c441fdb2cf4c4fe291311b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:06:43Z,use_quota=True,user_id='dd237867da72487aa97b127a2e4495b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Creating volume d63cfe3b-4389-4bc9-80ae-648ab082019e {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:06:45 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:45 devstack sudo[95799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e 1073741824
Nov 03 08:06:45 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:45 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c9982867-10e6-410d-8ce5-f2188f846acb tempest-SnapshotsActionsTest-2099954759 None] Create snapshot completed successfully
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-93c3989f-ca9b-436f-86ee-e0cb8cceb5a3-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-93c3989f-ca9b-436f-86ee-e0cb8cceb5a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-quobyte-93c3989f-ca9b-436f-86ee-e0cb8cceb5a3" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-93c3989f-ca9b-436f-86ee-e0cb8cceb5a3" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Deleting offline snapshot 93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 of volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:06:46 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] snapshot_file for this snap is: volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e 1073741824" returned: 0 in 0.698s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f966f64-e72f-4db6-a99c-8c2d872920b1]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:46 devstack sudo[95812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e
Nov 03 08:06:46 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:46 devstack sudo[95811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3
Nov 03 08:06:46 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:46 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e" returned: 0 in 0.368s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccf2682-edf4-42f0-8a10-0e208abacc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63cfe3b-4389-4bc9-80ae-648ab082019e', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0892cf40-7256-443d-99d1-85309a193d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:06:46 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Volume volume-d63cfe3b-4389-4bc9-80ae-648ab082019e (d63cfe3b-4389-4bc9-80ae-648ab082019e): created successfully
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0892cf40-7256-443d-99d1-85309a193d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Flow 'volume_create_manager' (aaebfb08-ad24-49ed-93a4-31f9d5b67c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:06:46 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3" returned: 0 in 0.477s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:06:46 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ae2b5aa7-8438-48b1-816c-95e062bc54a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Created volume successfully.
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d630db8-ee17-463c-996b-8406826a194d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:46 devstack sudo[95820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:06:46 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:47 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.442s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:06:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:47 devstack sudo[95826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3
Nov 03 08:06:47 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Creating offline snapshot 66803a3a-cb8f-4267-b835-a963099dde17 of volume d63cfe3b-4389-4bc9-80ae-648ab082019e {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:06:47 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9207435b-6a05-4d6d-9334-bd7126de78b5]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:47 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3" returned: 0 in 0.681s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:47 devstack sudo[95833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e
Nov 03 08:06:47 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:47 devstack sudo[95837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3
Nov 03 08:06:47 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:48 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.93c3989f-ca9b-436f-86ee-e0cb8cceb5a3" returned: 0 in 0.515s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:48 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e" returned: 0 in 0.748s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-93c3989f-ca9b-436f-86ee-e0cb8cceb5a3" released by "_delete_snapshot" :: held 2.336s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:48 devstack sudo[95855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17 1G
Nov 03 08:06:48 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" released by "delete_snapshot" :: held 2.414s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:48 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Created reservations ['b3f4200e-fba7-4951-b6f5-efd483aa915d', '7cd51795-42b3-420b-893e-498b38262037', '0d9bd1e4-f965-4187-9b59-097965630093', '198cff79-3603-4ec4-8a1c-d08f361b7a4f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:48 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Delete snapshot completed successfully.
Nov 03 08:06:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c44d55cd-f1a2-4dc0-a38a-50e694544f3d tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-93c3989f-ca9b-436f-86ee-e0cb8cceb5a3-delete_snapshot" released by "delete_snapshot" :: held 2.686s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:48 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17 1G" returned: 0 in 0.676s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63cfe3b-4389-4bc9-80ae-648ab082019e -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:49 devstack sudo[95878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63cfe3b-4389-4bc9-80ae-648ab082019e -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17
Nov 03 08:06:49 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:49 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63cfe3b-4389-4bc9-80ae-648ab082019e -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17" returned: 0 in 0.382s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:49 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17 is being set with open permissions: ugo+rw
Nov 03 08:06:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:49 devstack sudo[95886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17
Nov 03 08:06:49 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:49 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17" returned: 0 in 0.390s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:49 devstack sudo[95889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.info
Nov 03 08:06:49 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:50 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.info" returned: 0 in 0.304s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:50 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.info is being set with open permissions: ugo+rw
Nov 03 08:06:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:50 devstack sudo[95892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.info
Nov 03 08:06:50 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:50 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.info" returned: 0 in 0.305s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.936s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.812s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] Creating offline snapshot cc27412a-8fa6-45d4-96ca-b452056f83bb of volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:06:50 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9a543026-ca48-4e8b-84aa-eb2d76287bc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Create snapshot completed successfully
Nov 03 08:06:50 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5f3d1-e060-4a5e-b1f2-dcd44e37f76f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:50 devstack sudo[95896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:06:50 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:51 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.475s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:06:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:51 devstack sudo[95902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb 1G
Nov 03 08:06:51 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:52 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb 1G" returned: 0 in 1.104s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:52 devstack sudo[95980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb
Nov 03 08:06:52 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:52 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb" returned: 0 in 0.649s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:52 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb is being set with open permissions: ugo+rw
Nov 03 08:06:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:52 devstack sudo[96005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb
Nov 03 08:06:52 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Acquiring lock "cinder-66803a3a-cb8f-4267-b835-a963099dde17-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "cinder-66803a3a-cb8f-4267-b835-a963099dde17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Acquiring lock "cinder-quobyte-d63cfe3b-4389-4bc9-80ae-648ab082019e" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "cinder-quobyte-d63cfe3b-4389-4bc9-80ae-648ab082019e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:52 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Acquiring lock "cinder-quobyte-66803a3a-cb8f-4267-b835-a963099dde17" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "cinder-quobyte-66803a3a-cb8f-4267-b835-a963099dde17" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Deleting offline snapshot 66803a3a-cb8f-4267-b835-a963099dde17 of volume d63cfe3b-4389-4bc9-80ae-648ab082019e {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:06:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] snapshot_file for this snap is: volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:06:53 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[712c30b5-2010-4cb0-a1c0-870ac6c13981]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:53 devstack sudo[96012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17
Nov 03 08:06:53 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:53 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb" returned: 0 in 0.682s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.175s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:53 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d9e00727-1f34-414a-a20d-5d7a853670b2 tempest-SnapshotsActionsTest-2099954759 None] Create snapshot completed successfully
Nov 03 08:06:53 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17" returned: 0 in 0.848s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d63cfe3b-4389-4bc9-80ae-648ab082019e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca01f40-2fbb-48f4-aa93-f94b5e7b3c6f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-cc27412a-8fa6-45d4-96ca-b452056f83bb-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:54 devstack sudo[96028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e
Nov 03 08:06:54 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-cc27412a-8fa6-45d4-96ca-b452056f83bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-quobyte-cc27412a-8fa6-45d4-96ca-b452056f83bb" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-cc27412a-8fa6-45d4-96ca-b452056f83bb" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Deleting offline snapshot cc27412a-8fa6-45d4-96ca-b452056f83bb of volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] snapshot_file for this snap is: volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6a60a9-30b9-41c1-8ba1-c45238d24329]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:54 devstack sudo[96031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb
Nov 03 08:06:54 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:54 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e" returned: 0 in 0.659s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:54 devstack sudo[96036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17
Nov 03 08:06:54 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:55 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb" returned: 0 in 0.536s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[473e8371-08e9-431f-b1c0-754dfd515b1f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:55 devstack sudo[96045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:06:55 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:55 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17" returned: 0 in 0.517s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:55 devstack sudo[96049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17
Nov 03 08:06:55 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:55 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:55 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.793s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e.66803a3a-cb8f-4267-b835-a963099dde17" returned: 0 in 0.602s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:55 devstack sudo[96055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb
Nov 03 08:06:55 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "cinder-quobyte-66803a3a-cb8f-4267-b835-a963099dde17" released by "_delete_snapshot" :: held 2.942s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "cinder-quobyte-d63cfe3b-4389-4bc9-80ae-648ab082019e" released by "delete_snapshot" :: held 3.009s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:56 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Created reservations ['7cc4411b-57d7-4a77-885c-7080b38b7242', '6b05b242-5263-440b-921e-d02a6b31a4c1', 'b5aeec83-21df-4edd-b1c1-c0e31e19666a', 'bc9b4764-d9b1-472b-a7db-2bdda5cbe71e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:56 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Delete snapshot completed successfully.
Nov 03 08:06:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1c1967f8-9900-422e-acfc-008d8f5ef298 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "cinder-66803a3a-cb8f-4267-b835-a963099dde17-delete_snapshot" released by "delete_snapshot" :: held 3.332s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Acquiring lock "cinder-d63cfe3b-4389-4bc9-80ae-648ab082019e-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "cinder-d63cfe3b-4389-4bc9-80ae-648ab082019e-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Acquiring lock "cinder-quobyte-d63cfe3b-4389-4bc9-80ae-648ab082019e" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:06:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "cinder-quobyte-d63cfe3b-4389-4bc9-80ae-648ab082019e" acquired by "delete_volume" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:06:56 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb" returned: 0 in 0.981s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:56 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6786fd49-74e1-4944-b877-b92175e3bf8c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:56 devstack sudo[96061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb
Nov 03 08:06:56 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:57 devstack sudo[96062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e
Nov 03 08:06:57 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:57 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.cc27412a-8fa6-45d4-96ca-b452056f83bb" returned: 0 in 0.422s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-cc27412a-8fa6-45d4-96ca-b452056f83bb" released by "_delete_snapshot" :: held 2.895s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" released by "delete_snapshot" :: held 2.945s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:57 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Created reservations ['208931d8-7604-4a0d-b05a-4129fe1b0bdd', '3500fb69-3485-46d8-b163-05885a4cf86e', '373a1438-25eb-4ea5-8c3e-fa4b54a85a15', '5a780225-0906-4bdd-bd48-1ad7f01beaf4'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Delete snapshot completed successfully.
Nov 03 08:06:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bec0486e-dd17-4c0d-a355-17703284ef66 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-cc27412a-8fa6-45d4-96ca-b452056f83bb-delete_snapshot" released by "delete_snapshot" :: held 3.357s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:57 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e" returned: 0 in 0.880s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:57 devstack sudo[96069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e
Nov 03 08:06:57 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:58 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d63cfe3b-4389-4bc9-80ae-648ab082019e" returned: 0 in 0.468s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "cinder-quobyte-d63cfe3b-4389-4bc9-80ae-648ab082019e" released by "delete_volume" :: held 1.525s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Created reservations ['a94f68e5-4861-4458-9e26-2556cb3227b0', '3baa9d76-18df-497d-907d-be618ea81e6d', 'dde86acd-a6d8-4f98-b65b-30ac5f4a1a28', '0e890408-a810-49c3-af79-87b2412a65f8'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:58 devstack sudo[96074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:06:58 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:06:58 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.361s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:06:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Deleted volume successfully.
Nov 03 08:06:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d8e6158-d40d-45a5-b67e-de0f41b7fa62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1626411587 None] Lock "cinder-d63cfe3b-4389-4bc9-80ae-648ab082019e-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:06:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:06:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:06:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] Creating offline snapshot fce95991-9e57-489c-9646-f7f8b51a2095 of volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:06:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d01002-eac3-410a-9b57-15136c0297bb]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:06:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:06:59 devstack sudo[96079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:06:59 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:00 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.743s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:07:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:00 devstack sudo[96084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095 1G
Nov 03 08:07:00 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:01 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095 1G" returned: 0 in 0.568s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:01 devstack sudo[96089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095
Nov 03 08:07:01 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:01 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095" returned: 0 in 0.344s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:01 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095 is being set with open permissions: ugo+rw
Nov 03 08:07:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:01 devstack sudo[96094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095
Nov 03 08:07:01 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:01 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095" returned: 0 in 0.342s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5a95f0f1-46d2-4551-bca8-4313027bde80 tempest-SnapshotsActionsTest-2099954759 None] Create snapshot completed successfully
Nov 03 08:07:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-fce95991-9e57-489c-9646-f7f8b51a2095-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-fce95991-9e57-489c-9646-f7f8b51a2095-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-quobyte-fce95991-9e57-489c-9646-f7f8b51a2095" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-fce95991-9e57-489c-9646-f7f8b51a2095" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Deleting offline snapshot fce95991-9e57-489c-9646-f7f8b51a2095 of volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] snapshot_file for this snap is: volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0988529-2ac1-42d2-a851-88b5ea318c77]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:03 devstack sudo[96121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095
Nov 03 08:07:03 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:03 devstack sudo[96123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:07:03 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:03 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.353s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:07:03 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095" returned: 0 in 0.643s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad980b72-9192-4295-b64d-a2a678b3a5fd]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:03 devstack sudo[96130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:07:03 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:04 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.463s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:07:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:04 devstack sudo[96135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095
Nov 03 08:07:04 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:04 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095" returned: 0 in 0.406s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:04 devstack sudo[96140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095
Nov 03 08:07:04 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:05 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.fce95991-9e57-489c-9646-f7f8b51a2095" returned: 0 in 0.381s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-fce95991-9e57-489c-9646-f7f8b51a2095" released by "_delete_snapshot" :: held 2.039s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" released by "delete_snapshot" :: held 2.078s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:05 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Created reservations ['3524684c-af98-4c7c-bbc7-813a65763a37', '6e4fccc4-9cfd-4885-a122-371f990063a8', '4b8a4d71-c3a4-4769-ba97-6317b84cb1f1', '548a01d9-673a-49c2-a1ce-288932a928a4'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:07:05 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Delete snapshot completed successfully.
Nov 03 08:07:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9442d10f-899f-4000-8c5b-982016790272 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-fce95991-9e57-489c-9646-f7f8b51a2095-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:07:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:07:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] Creating offline snapshot 95682ac1-79b1-4fc2-b389-5a31e9fcc95e of volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:07:06 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed60208-acce-46ee-a5ae-5c275db3bd75]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:06 devstack sudo[96143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:07:06 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:07 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.449s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:07:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:07 devstack sudo[96149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e 1G
Nov 03 08:07:07 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:07 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e 1G" returned: 0 in 0.661s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:07 devstack sudo[96172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e
Nov 03 08:07:07 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:08 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e" returned: 0 in 0.345s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:08 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e is being set with open permissions: ugo+rw
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:08 devstack sudo[96178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e
Nov 03 08:07:08 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:08 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e" returned: 0 in 0.250s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-03804f1a-0d39-43e4-a296-3e35c85e5d46 tempest-SnapshotsActionsTest-2099954759 None] Create snapshot completed successfully
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-95682ac1-79b1-4fc2-b389-5a31e9fcc95e-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-95682ac1-79b1-4fc2-b389-5a31e9fcc95e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Acquiring lock "cinder-quobyte-95682ac1-79b1-4fc2-b389-5a31e9fcc95e" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-95682ac1-79b1-4fc2-b389-5a31e9fcc95e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Deleting offline snapshot 95682ac1-79b1-4fc2-b389-5a31e9fcc95e of volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] snapshot_file for this snap is: volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba69b1d3-6a2d-4310-920b-91a2d7ddcd39]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:09 devstack sudo[96181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e
Nov 03 08:07:09 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:09 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e" returned: 0 in 0.430s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:07:09 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0102328f-6be8-475d-b001-e2a90894cbe9]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:09 devstack sudo[96203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:07:09 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:09 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.402s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:07:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:09 devstack sudo[96208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e
Nov 03 08:07:09 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:10 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e" returned: 0 in 0.401s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:10 devstack sudo[96214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e
Nov 03 08:07:10 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:10 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.95682ac1-79b1-4fc2-b389-5a31e9fcc95e" returned: 0 in 0.258s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-95682ac1-79b1-4fc2-b389-5a31e9fcc95e" released by "_delete_snapshot" :: held 1.625s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" released by "delete_snapshot" :: held 1.658s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:10 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Created reservations ['e1306bd4-fa18-4744-bf22-3a150e39e550', 'e95b0303-1679-4679-bd2f-1fb0a1ef602a', 'afde8278-c82c-4df8-aab4-d4cb627415b3', '29586b25-27ac-4298-8108-ef6180060fb6'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:07:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Delete snapshot completed successfully.
Nov 03 08:07:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73408841-e917-4701-be34-71a0d38e1739 tempest-SnapshotsActionsTest-1018884295 None] Lock "cinder-95682ac1-79b1-4fc2-b389-5a31e9fcc95e-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "cinder-23bf9a06-5c45-45a0-9747-dbc8736c85e8-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Lock "cinder-23bf9a06-5c45-45a0-9747-dbc8736c85e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "cinder-quobyte-23bf9a06-5c45-45a0-9747-dbc8736c85e8" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Lock "cinder-quobyte-23bf9a06-5c45-45a0-9747-dbc8736c85e8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Deleting offline snapshot 23bf9a06-5c45-45a0-9747-dbc8736c85e8 of volume d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:07:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] snapshot_file for this snap is: volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:07:11 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[44130e17-fb3a-40c5-aeb0-3c1b0aa23615]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:11 devstack sudo[96217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:07:11 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:12 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:07:12 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa608981-dad4-4c47-99eb-8d2fa305f1d4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:12 devstack sudo[96222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82
Nov 03 08:07:12 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:12 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82" returned: 0 in 0.386s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:12 devstack sudo[96227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:07:12 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:12 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.358s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:12 devstack sudo[96232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8
Nov 03 08:07:12 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:13 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82.23bf9a06-5c45-45a0-9747-dbc8736c85e8" returned: 0 in 0.257s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Lock "cinder-quobyte-23bf9a06-5c45-45a0-9747-dbc8736c85e8" released by "_delete_snapshot" :: held 1.519s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" released by "delete_snapshot" :: held 1.545s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:13 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Created reservations ['f63cbbad-211d-4b11-8cf5-77f5397e99d9', 'f8886929-909d-4471-998f-1d0d9e71583b', '1a237ebb-654d-4f55-8d3e-39f2e19b1619', '970d1f8a-6821-4385-8b6b-ecc363eeef1d'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:07:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Delete snapshot completed successfully.
Nov 03 08:07:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-807281ce-6bdf-4661-bf03-bbc0c2c951ab tempest-SnapshotsActionsTest-2099954759 None] Lock "cinder-23bf9a06-5c45-45a0-9747-dbc8736c85e8-delete_snapshot" released by "delete_snapshot" :: held 1.671s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "cinder-d03e2c19-ff3f-4b38-84f5-ae0710723c82-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Lock "cinder-d03e2c19-ff3f-4b38-84f5-ae0710723c82-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3a515-f210-459f-8dfb-09cb9318f6fa]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:14 devstack sudo[96236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82
Nov 03 08:07:14 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:14 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82" returned: 0 in 0.404s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:14 devstack sudo[96241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82
Nov 03 08:07:14 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:14 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d03e2c19-ff3f-4b38-84f5-ae0710723c82" returned: 0 in 0.302s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Lock "cinder-quobyte-d03e2c19-ff3f-4b38-84f5-ae0710723c82" released by "delete_volume" :: held 0.781s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Created reservations ['0fc378ed-2513-4ea0-a732-2b5eeff46966', '5cbdfa83-75f2-456c-9a46-b29868f47765', '6974ea67-a644-463c-a6f5-9d57b368ffda', '859eae25-b767-42b4-899e-764402a4831b'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:14 devstack sudo[96244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:07:14 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:15 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.312s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:15 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:07:15 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Deleted volume successfully.
Nov 03 08:07:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2bc42a6c-759b-4cc9-a9c4-440c6f3a8341 tempest-SnapshotsActionsTest-2099954759 None] Lock "cinder-d03e2c19-ff3f-4b38-84f5-ae0710723c82-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-55821eb3-dbb3-4b6e-8718-34ec2293fdd0 req-1ddf028b-f353-4295-9e0c-473ce2b8d257 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:07:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-55821eb3-dbb3-4b6e-8718-34ec2293fdd0 req-1ddf028b-f353-4295-9e0c-473ce2b8d257 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:07:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-55821eb3-dbb3-4b6e-8718-34ec2293fdd0 req-1ddf028b-f353-4295-9e0c-473ce2b8d257 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-55821eb3-dbb3-4b6e-8718-34ec2293fdd0 req-1ddf028b-f353-4295-9e0c-473ce2b8d257 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-abe2a0aa-716d-4f2f-9306-9ce64261056d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93ce34ba-8003-4af8-a6c6-3ac4f5ef0fe7', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:07:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-55821eb3-dbb3-4b6e-8718-34ec2293fdd0 req-1ddf028b-f353-4295-9e0c-473ce2b8d257 tempest-TestServerVolumeAttachmentScenario-1876329012 None] attachment_update completed successfully.
Nov 03 08:07:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-c9dd46fc-9c5c-420f-8fab-64cdccbcfd95 req-701dea43-5b13-408c-81f4-d1bb21de05a5 tempest-AttachVolumeNegativeTest-395788549 None] Terminate volume connection completed successfully.
Nov 03 08:07:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-c9dd46fc-9c5c-420f-8fab-64cdccbcfd95 req-701dea43-5b13-408c-81f4-d1bb21de05a5 tempest-AttachVolumeNegativeTest-395788549 None] Deleting attachment e31737ff-6c1e-4f0a-a8d8-3c1bfc26770e. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:07:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-23cd10f9-ca29-46c6-94ef-19ce60bbc0e8 req-beed94a9-9896-433f-82ad-fc81b9b7fc9c tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:07:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-23cd10f9-ca29-46c6-94ef-19ce60bbc0e8 req-beed94a9-9896-433f-82ad-fc81b9b7fc9c tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:07:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-23cd10f9-ca29-46c6-94ef-19ce60bbc0e8 req-beed94a9-9896-433f-82ad-fc81b9b7fc9c tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-23cd10f9-ca29-46c6-94ef-19ce60bbc0e8 req-beed94a9-9896-433f-82ad-fc81b9b7fc9c tempest-TestServerVolumeAttachmentScenario-1876329012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-382b3d0b-7578-4c02-8487-5cf56ad23827', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32ff27f4-8600-4e9d-8e26-2df823b8a210', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:07:29 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-23cd10f9-ca29-46c6-94ef-19ce60bbc0e8 req-beed94a9-9896-433f-82ad-fc81b9b7fc9c tempest-TestServerVolumeAttachmentScenario-1876329012 None] attachment_update completed successfully.
Nov 03 08:07:32 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-0f31c832-61bd-4c1e-a526-d045ff8cc8e2 req-cc180860-4221-43d3-bc21-94100df18e38 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Terminate volume connection completed successfully.
Nov 03 08:07:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-0f31c832-61bd-4c1e-a526-d045ff8cc8e2 req-cc180860-4221-43d3-bc21-94100df18e38 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Deleting attachment 32ff27f4-8600-4e9d-8e26-2df823b8a210. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:07:34 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-256eee77-b9e2-4776-bc20-46db2fc07901 req-34fc2fa0-6620-4587-bfa0-07257a06c9f8 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Terminate volume connection completed successfully.
Nov 03 08:07:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-256eee77-b9e2-4776-bc20-46db2fc07901 req-34fc2fa0-6620-4587-bfa0-07257a06c9f8 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Deleting attachment 93ce34ba-8003-4af8-a6c6-3ac4f5ef0fe7. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:07:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "cinder-382b3d0b-7578-4c02-8487-5cf56ad23827-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "cinder-382b3d0b-7578-4c02-8487-5cf56ad23827-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:41 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=83,cinder:UPDATE=77,cinder:INSERT=23,cinder:DELETE=8 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:07:41 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=96,cinder:UPDATE=76,cinder:DELETE=5,cinder:INSERT=16 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:07:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "cinder-quobyte-382b3d0b-7578-4c02-8487-5cf56ad23827" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "cinder-quobyte-382b3d0b-7578-4c02-8487-5cf56ad23827" acquired by "delete_volume" :: waited 0.038s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:41 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0042f2-e4f0-4e55-a7a3-a7a3f6bf5958]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:41 devstack sudo[96437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827
Nov 03 08:07:41 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:42 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827" returned: 0 in 0.629s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:42 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827
Nov 03 08:07:42 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:42 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-382b3d0b-7578-4c02-8487-5cf56ad23827" returned: 0 in 0.465s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "cinder-quobyte-382b3d0b-7578-4c02-8487-5cf56ad23827" released by "delete_volume" :: held 1.206s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:42 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Created reservations ['8227572e-24a1-4b17-8a36-8facf7c44e26', '17eacc7d-b5b7-42e1-b5ab-66ac83384b30', '30b3ded6-828f-4868-9278-f1777774e66e', '7cce1128-634a-4544-b0b6-3ff2d57b449f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:07:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:07:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:07:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:43 devstack sudo[96460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:07:43 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:43 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.355s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:07:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Deleted volume successfully.
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-42ea97bb-7480-479a-bc5f-65540d202ad1 tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "cinder-382b3d0b-7578-4c02-8487-5cf56ad23827-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Flow 'volume_create_manager' (3ce9a6b0-f6ce-4fe0-959f-298e0ff36782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295f4495-0c1c-4601-94fd-960cede8b8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295f4495-0c1c-4601-94fd-960cede8b8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-33483302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9c10a0-4213-439f-86dc-2b91dfb3f96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5be98fbab74d71bfe72a4d358220ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:07:44Z,use_quota=True,user_id='e69f902efc064a39a8b64dd2fdfcd930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddff5bf-7786-4b38-ae7b-ae4680a7826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddff5bf-7786-4b38-ae7b-ae4680a7826e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3f1c90-9f5d-4fab-a945-9d9450f2261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3f1c90-9f5d-4fab-a945-9d9450f2261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9c10a0-4213-439f-86dc-2b91dfb3f96f', 'volume_name': 'volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3232ecfa-ad74-4bba-8d46-33a07b0e990a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3232ecfa-ad74-4bba-8d46-33a07b0e990a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71594f5-6f5f-430a-a014-883ca01530c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:07:43 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Volume 3e9c10a0-4213-439f-86dc-2b91dfb3f96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f', 'volume_size': 1}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-33483302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9c10a0-4213-439f-86dc-2b91dfb3f96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5be98fbab74d71bfe72a4d358220ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:07:44Z,use_quota=True,user_id='e69f902efc064a39a8b64dd2fdfcd930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Creating volume 3e9c10a0-4213-439f-86dc-2b91dfb3f96f {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:07:43 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "cinder-abe2a0aa-716d-4f2f-9306-9ce64261056d-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "cinder-abe2a0aa-716d-4f2f-9306-9ce64261056d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:43 devstack sudo[96464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f 1073741824
Nov 03 08:07:43 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "cinder-quobyte-abe2a0aa-716d-4f2f-9306-9ce64261056d" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "cinder-quobyte-abe2a0aa-716d-4f2f-9306-9ce64261056d" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:44 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7346d713-229f-4235-b0b9-e59de6382a52]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:44 devstack sudo[96466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d
Nov 03 08:07:44 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:44 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:44 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d" returned: 0 in 0.571s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f 1073741824" returned: 0 in 0.714s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:44 devstack sudo[96476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d
Nov 03 08:07:44 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:44 devstack sudo[96478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f
Nov 03 08:07:44 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:44 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f" returned: 0 in 0.297s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:07:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:44 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71594f5-6f5f-430a-a014-883ca01530c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8a43e3-5d17-4583-ba30-69f49305a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-abe2a0aa-716d-4f2f-9306-9ce64261056d" returned: 0 in 0.431s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:45 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Volume volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f (3e9c10a0-4213-439f-86dc-2b91dfb3f96f): created successfully
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8a43e3-5d17-4583-ba30-69f49305a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Flow 'volume_create_manager' (3ce9a6b0-f6ce-4fe0-959f-298e0ff36782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "cinder-quobyte-abe2a0aa-716d-4f2f-9306-9ce64261056d" released by "delete_volume" :: held 1.089s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:45 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2c0f6199-66e7-4ec0-8dac-bf3383558ba7 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Created volume successfully.
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Created reservations ['eb5ebf9b-af1c-4fe0-b103-9f1eb33b2f11', 'ef6070f8-7306-492a-a9c3-ee735784e71c', '874f14ba-1744-4f4e-8d6e-89170fac1edb', '33d78067-0133-4e9e-9185-87ed7d584a1f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:45 devstack sudo[96486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:07:45 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:45 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.520s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:07:45 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Deleted volume successfully.
Nov 03 08:07:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-883e668d-5f6b-4b5c-bc4b-ace84853fcec tempest-TestServerVolumeAttachmentScenario-1876329012 None] Lock "cinder-abe2a0aa-716d-4f2f-9306-9ce64261056d-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Acquiring lock "cinder-3e9c10a0-4213-439f-86dc-2b91dfb3f96f-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Lock "cinder-3e9c10a0-4213-439f-86dc-2b91dfb3f96f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Acquiring lock "cinder-quobyte-3e9c10a0-4213-439f-86dc-2b91dfb3f96f" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:07:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Lock "cinder-quobyte-3e9c10a0-4213-439f-86dc-2b91dfb3f96f" acquired by "delete_volume" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:07:48 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6e87be-3b4b-45d7-bd42-0edfc753e5ae]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:07:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:48 devstack sudo[96553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f
Nov 03 08:07:48 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:48 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f" returned: 0 in 0.608s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:48 devstack sudo[96559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f
Nov 03 08:07:48 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:49 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3e9c10a0-4213-439f-86dc-2b91dfb3f96f" returned: 0 in 0.295s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Lock "cinder-quobyte-3e9c10a0-4213-439f-86dc-2b91dfb3f96f" released by "delete_volume" :: held 0.989s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Created reservations ['11251789-2dde-43ec-90b2-d2fecc91ef93', '1b21af2b-cef1-428a-bff1-876a00e8570a', '1e6e3089-7017-431c-bd62-d7623f2ca385', '9d9a8f99-f121-496c-b50f-bd911feee1f2'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:07:49 devstack sudo[96562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:07:49 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:07:49 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.435s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:07:49 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Deleted volume successfully.
Nov 03 08:07:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cfcfb002-2ac4-4bfc-b222-43a5c3d84b65 tempest-VolumeQuotasNegativeTestJSON-1190864361 None] Lock "cinder-3e9c10a0-4213-439f-86dc-2b91dfb3f96f-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:07:59 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=27 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:07:59 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=14,cinder:INSERT=7,cinder:UPDATE=26,cinder:DELETE=4 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:03 devstack sudo[96676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:08:03 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:03 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.404s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:08:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (f25f37a3-b501-4436-b048-96d95ff583f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790aad81-3811-4fdb-ba23-c509726082b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790aad81-3811-4fdb-ba23-c509726082b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-926901654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b92a84-370b-4530-9d2d-4253bd151f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:06Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a344892-b927-4e49-b614-43bf82666a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a344892-b927-4e49-b614-43bf82666a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13163c47-afb4-4ebd-aa09-f17a9a39aeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13163c47-afb4-4ebd-aa09-f17a9a39aeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b92a84-370b-4530-9d2d-4253bd151f3c', 'volume_name': 'volume-46b92a84-370b-4530-9d2d-4253bd151f3c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421fe4a7-c2d8-4a8d-b8c6-42771276a4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421fe4a7-c2d8-4a8d-b8c6-42771276a4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe87083-8bdd-4fd6-badd-1768810ee8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:06 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Volume 46b92a84-370b-4530-9d2d-4253bd151f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b92a84-370b-4530-9d2d-4253bd151f3c', 'volume_size': 1}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-926901654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b92a84-370b-4530-9d2d-4253bd151f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:06Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Creating volume 46b92a84-370b-4530-9d2d-4253bd151f3c {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:06 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:06 devstack sudo[96685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c 1073741824
Nov 03 08:08:06 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:07 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c 1073741824" returned: 0 in 0.879s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:07 devstack sudo[96691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c
Nov 03 08:08:07 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:07 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c" returned: 0 in 0.561s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe87083-8bdd-4fd6-badd-1768810ee8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b92a84-370b-4530-9d2d-4253bd151f3c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e57263-3d41-41d1-974b-aa3b6a4e70f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:08 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Volume volume-46b92a84-370b-4530-9d2d-4253bd151f3c (46b92a84-370b-4530-9d2d-4253bd151f3c): created successfully
Nov 03 08:08:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e57263-3d41-41d1-974b-aa3b6a4e70f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (f25f37a3-b501-4436-b048-96d95ff583f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-395d9f06-b081-4a50-92b8-6cabe504867f tempest-VolumesActionsTest-251792135 None] Created volume successfully.
Nov 03 08:08:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0e5da775-7ba3-4a67-b122-9c9dca35dc89 tempest-VolumesActionsTest-251792135 None] Acquiring lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c" by "attach_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0e5da775-7ba3-4a67-b122-9c9dca35dc89 tempest-VolumesActionsTest-251792135 None] Lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c" acquired by "attach_volume" :: waited 0.036s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0e5da775-7ba3-4a67-b122-9c9dca35dc89 tempest-VolumesActionsTest-251792135 None] Attaching volume 46b92a84-370b-4530-9d2d-4253bd151f3c to instance 48f6349c-9304-4d3f-8432-3dd6e755cfc4 at mountpoint /dev/vdb on host None.
Nov 03 08:08:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0e5da775-7ba3-4a67-b122-9c9dca35dc89 tempest-VolumesActionsTest-251792135 None] Attach volume completed successfully.
Nov 03 08:08:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0e5da775-7ba3-4a67-b122-9c9dca35dc89 tempest-VolumesActionsTest-251792135 None] Lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c" released by "attach_volume" :: held 0.198s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-96f5761e-2c10-49f7-bd25-a8fe54fa1519 tempest-VolumesActionsTest-1155588931 None] Terminate volume connection completed successfully.
Nov 03 08:08:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-96f5761e-2c10-49f7-bd25-a8fe54fa1519 tempest-VolumesActionsTest-1155588931 None] Acquiring lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c-detach_volume" by "detach_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-96f5761e-2c10-49f7-bd25-a8fe54fa1519 tempest-VolumesActionsTest-1155588931 None] Lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-96f5761e-2c10-49f7-bd25-a8fe54fa1519 tempest-VolumesActionsTest-1155588931 None] Detaching volume 46b92a84-370b-4530-9d2d-4253bd151f3c from instance 48f6349c-9304-4d3f-8432-3dd6e755cfc4.
Nov 03 08:08:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-96f5761e-2c10-49f7-bd25-a8fe54fa1519 tempest-VolumesActionsTest-1155588931 None] Detach volume completed successfully.
Nov 03 08:08:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-96f5761e-2c10-49f7-bd25-a8fe54fa1519 tempest-VolumesActionsTest-1155588931 None] Lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3a0de054-a6bb-4794-9b1f-f1c7b13c827f tempest-VolumesActionsTest-251792135 None] Acquiring lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c-detach_volume" by "detach_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3a0de054-a6bb-4794-9b1f-f1c7b13c827f tempest-VolumesActionsTest-251792135 None] Lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3a0de054-a6bb-4794-9b1f-f1c7b13c827f tempest-VolumesActionsTest-251792135 None] Volume detach called, but volume not attached.
Nov 03 08:08:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3a0de054-a6bb-4794-9b1f-f1c7b13c827f tempest-VolumesActionsTest-251792135 None] Lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Acquiring lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Acquiring lock "cinder-quobyte-46b92a84-370b-4530-9d2d-4253bd151f3c" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Lock "cinder-quobyte-46b92a84-370b-4530-9d2d-4253bd151f3c" acquired by "delete_volume" :: waited 0.040s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Flow 'volume_create_manager' (2695b018-1826-4023-8404-6a004780f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faff662-dd79-42ab-97e2-a692806cbd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70e5f80-581b-44ff-8603-4b91b3699e8c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faff662-dd79-42ab-97e2-a692806cbd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-218829258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b00ae0f-4883-46ea-9132-3586aba968a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e2828e78d44c8c84aeede00f87b723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:11Z,use_quota=True,user_id='7c2d8687f13c4b8a84de72a89dce0c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0163e9ef-acc3-4a8f-95ef-f61920b805d1),volume_type_id=0163e9ef-acc3-4a8f-95ef-f61920b805d1)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337fb6d6-aae5-48d1-8889-c39306a839d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337fb6d6-aae5-48d1-8889-c39306a839d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb730697-7a4b-4f42-889a-8e2344346ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb730697-7a4b-4f42-889a-8e2344346ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b00ae0f-4883-46ea-9132-3586aba968a9', 'volume_name': 'volume-0b00ae0f-4883-46ea-9132-3586aba968a9', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093ac46a-4ed7-41af-a9c6-3a7bcd52ab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093ac46a-4ed7-41af-a9c6-3a7bcd52ab55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245b6d7b-719c-4785-b337-6cd750295aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:11 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Volume 0b00ae0f-4883-46ea-9132-3586aba968a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b00ae0f-4883-46ea-9132-3586aba968a9', 'volume_size': 1}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-218829258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b00ae0f-4883-46ea-9132-3586aba968a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e2828e78d44c8c84aeede00f87b723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:11Z,use_quota=True,user_id='7c2d8687f13c4b8a84de72a89dce0c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0163e9ef-acc3-4a8f-95ef-f61920b805d1),volume_type_id=0163e9ef-acc3-4a8f-95ef-f61920b805d1)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Creating volume 0b00ae0f-4883-46ea-9132-3586aba968a9 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:11 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:11 devstack sudo[96695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9 1073741824
Nov 03 08:08:11 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:11 devstack sudo[96694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c
Nov 03 08:08:11 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:11 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c" returned: 0 in 0.646s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:11 devstack sudo[96706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c
Nov 03 08:08:11 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:11 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9 1073741824" returned: 0 in 0.639s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:12 devstack sudo[96708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9
Nov 03 08:08:12 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:12 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-46b92a84-370b-4530-9d2d-4253bd151f3c" returned: 0 in 0.325s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Lock "cinder-quobyte-46b92a84-370b-4530-9d2d-4253bd151f3c" released by "delete_volume" :: held 1.064s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Created reservations ['c3c880ce-1b50-4023-8301-10f3abcea274', '9de133fb-0a6f-4cdb-8be0-272560650b20', '5da39192-412f-4b9c-aed2-238f9295ba50', '3a7368d2-cab6-4542-a1d8-f112b24fb583'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:12 devstack sudo[96712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:08:12 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:12 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9" returned: 0 in 0.432s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245b6d7b-719c-4785-b337-6cd750295aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b00ae0f-4883-46ea-9132-3586aba968a9', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7dfd615-d801-4c05-ac7e-f1a8d99480a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:12 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Volume volume-0b00ae0f-4883-46ea-9132-3586aba968a9 (0b00ae0f-4883-46ea-9132-3586aba968a9): created successfully
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7dfd615-d801-4c05-ac7e-f1a8d99480a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Flow 'volume_create_manager' (2695b018-1826-4023-8404-6a004780f013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5ad907c1-694c-469b-a507-04bc68a4e42b tempest-VolumeTypesAccessTest-1201585883 None] Created volume successfully.
Nov 03 08:08:12 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.272s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:08:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Deleted volume successfully.
Nov 03 08:08:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-63426180-6b66-444d-af25-9260929a7c16 tempest-VolumesActionsTest-251792135 None] Lock "cinder-46b92a84-370b-4530-9d2d-4253bd151f3c-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Acquiring lock "cinder-0b00ae0f-4883-46ea-9132-3586aba968a9-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Lock "cinder-0b00ae0f-4883-46ea-9132-3586aba968a9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Acquiring lock "cinder-quobyte-0b00ae0f-4883-46ea-9132-3586aba968a9" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Lock "cinder-quobyte-0b00ae0f-4883-46ea-9132-3586aba968a9" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:13 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af43574-cf7f-464a-ad9a-f33354d74690]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:08:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:13 devstack sudo[96716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9
Nov 03 08:08:13 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:14 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9" returned: 0 in 0.599s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:14 devstack sudo[96740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9
Nov 03 08:08:14 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:14 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0b00ae0f-4883-46ea-9132-3586aba968a9" returned: 0 in 0.349s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Lock "cinder-quobyte-0b00ae0f-4883-46ea-9132-3586aba968a9" released by "delete_volume" :: held 1.069s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:14 devstack cinder-volume[86851]: WARNING cinder.quota [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1269416416 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1269416416, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:08:14 devstack cinder-volume[86851]: WARNING cinder.quota [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1269416416 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1269416416, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Created reservations ['91ac7343-a656-43c1-bf09-ed5f28dbbf5c', '3230139a-008e-40ee-959d-7e75475e6c33', '5bdb618d-9a96-47a8-b0ae-485642ee7b18', 'acb75fc9-326e-4d1b-8a7f-a1ef20f6bbd9'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:14 devstack sudo[96747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:08:14 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:14 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Flow 'volume_create_manager' (fa9cf9d9-f8a1-4f59-aeb1-07f0ac450e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c2a6a8-0db4-43c6-b182-1ee41a2531ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c2a6a8-0db4-43c6-b182-1ee41a2531ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1517077019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50375dfb-eef8-4cb5-a841-99e6bb4d919e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aed085f9cf4550923d1e72500cd167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:15Z,use_quota=True,user_id='18ac9ad65aa44dae92bb70f4e039dcd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1ce8fe-f12a-4e45-99ff-da1c09fcbb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1ce8fe-f12a-4e45-99ff-da1c09fcbb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e83879-4d9c-4fa6-9fc8-1b1cd06253a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e83879-4d9c-4fa6-9fc8-1b1cd06253a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50375dfb-eef8-4cb5-a841-99e6bb4d919e', 'volume_name': 'volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbb1004-cf5b-44e6-a7e2-d394baa21d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbb1004-cf5b-44e6-a7e2-d394baa21d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05e50bc-34f3-4693-9825-e0a7cf72f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:15 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Volume 50375dfb-eef8-4cb5-a841-99e6bb4d919e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e', 'volume_size': 1}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1517077019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50375dfb-eef8-4cb5-a841-99e6bb4d919e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aed085f9cf4550923d1e72500cd167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:15Z,use_quota=True,user_id='18ac9ad65aa44dae92bb70f4e039dcd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Creating volume 50375dfb-eef8-4cb5-a841-99e6bb4d919e {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:15 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:15 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:15 devstack sudo[96751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e 1073741824
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.520s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:08:15 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:15 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Deleted volume successfully.
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-68d21cd7-2ce4-4f7d-adb4-31d02b7047a1 tempest-VolumeTypesAccessTest-1201585883 None] Lock "cinder-0b00ae0f-4883-46ea-9132-3586aba968a9-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:15 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e 1073741824" returned: 0 in 0.576s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:15 devstack sudo[96758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e
Nov 03 08:08:15 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:16 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e" returned: 0 in 0.340s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05e50bc-34f3-4693-9825-e0a7cf72f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cd0229-a69e-459e-83b5-2b059be0cb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:16 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Volume volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e (50375dfb-eef8-4cb5-a841-99e6bb4d919e): created successfully
Nov 03 08:08:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cd0229-a69e-459e-83b5-2b059be0cb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Flow 'volume_create_manager' (fa9cf9d9-f8a1-4f59-aeb1-07f0ac450e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:16 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2a0a2705-7d06-445a-89e4-26be42b5913b tempest-AttachVolumeNegativeTest-395788549 None] Created volume successfully.
Nov 03 08:08:16 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (7500a857-ebe7-4b2c-b64a-e2782eef6042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bea4c0d-fff9-472d-b701-cc57c0dbb3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bea4c0d-fff9-472d-b701-cc57c0dbb3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1602146361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3399597c-260d-4fa0-b5c6-37ba7b0c1748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:17Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40833be5-33a0-4b74-aa81-eb8035a07bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40833be5-33a0-4b74-aa81-eb8035a07bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be8ff7e-c3f8-4243-b7a9-5466ab884828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be8ff7e-c3f8-4243-b7a9-5466ab884828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3399597c-260d-4fa0-b5c6-37ba7b0c1748', 'volume_name': 'volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4f7c92-e314-42d8-a3e5-9a53c2262805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4f7c92-e314-42d8-a3e5-9a53c2262805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39bc83d-ab1f-48d9-8761-0bed9e452788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:17 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Volume 3399597c-260d-4fa0-b5c6-37ba7b0c1748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748', 'volume_size': 1}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1602146361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3399597c-260d-4fa0-b5c6-37ba7b0c1748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:17Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Creating volume 3399597c-260d-4fa0-b5c6-37ba7b0c1748 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:17 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:17 devstack sudo[96763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748 1073741824
Nov 03 08:08:17 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:17 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748 1073741824" returned: 0 in 0.738s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:17 devstack sudo[96785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748
Nov 03 08:08:17 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-cf904476-cd82-404b-a5a4-ede8acba28c4 req-bb048662-50e6-4512-8149-175d8c69bf7c tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:18 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748" returned: 0 in 0.322s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-cf904476-cd82-404b-a5a4-ede8acba28c4 req-bb048662-50e6-4512-8149-175d8c69bf7c tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.135s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39bc83d-ab1f-48d9-8761-0bed9e452788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134b5bd1-178f-4475-8296-b0e3d2c9f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-cf904476-cd82-404b-a5a4-ede8acba28c4 req-bb048662-50e6-4512-8149-175d8c69bf7c tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:18 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Volume volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748 (3399597c-260d-4fa0-b5c6-37ba7b0c1748): created successfully
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134b5bd1-178f-4475-8296-b0e3d2c9f002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (7500a857-ebe7-4b2c-b64a-e2782eef6042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e3d682f2-6dad-4038-abd3-639ea2d7ecb1 tempest-VolumesActionsTest-251792135 None] Created volume successfully.
Nov 03 08:08:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-cf904476-cd82-404b-a5a4-ede8acba28c4 req-bb048662-50e6-4512-8149-175d8c69bf7c tempest-AttachVolumeNegativeTest-395788549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6ef553d-a327-435a-a58a-6f919d9fdee7', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:08:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-cf904476-cd82-404b-a5a4-ede8acba28c4 req-bb048662-50e6-4512-8149-175d8c69bf7c tempest-AttachVolumeNegativeTest-395788549 None] attachment_update completed successfully.
Nov 03 08:08:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Acquiring lock "cinder-3399597c-260d-4fa0-b5c6-37ba7b0c1748-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Lock "cinder-3399597c-260d-4fa0-b5c6-37ba7b0c1748-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Acquiring lock "cinder-quobyte-3399597c-260d-4fa0-b5c6-37ba7b0c1748" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Lock "cinder-quobyte-3399597c-260d-4fa0-b5c6-37ba7b0c1748" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:19 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[750ce1b0-cd46-476e-84c2-21af2224cf9f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:08:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:19 devstack sudo[97206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748
Nov 03 08:08:19 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:20 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748" returned: 0 in 0.545s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:20 devstack sudo[97211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748
Nov 03 08:08:20 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:20 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3399597c-260d-4fa0-b5c6-37ba7b0c1748" returned: 0 in 0.581s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Lock "cinder-quobyte-3399597c-260d-4fa0-b5c6-37ba7b0c1748" released by "delete_volume" :: held 1.204s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Created reservations ['9c547419-2b29-4364-9bfd-02675bf6eacf', '8394b597-0175-4cc9-a9bb-fa179c57efba', '09b7331e-2085-4f9d-bcc3-82c81a23548b', 'e9aebb4c-73c5-4bb6-ad92-1c8b12e74cd8'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:20 devstack sudo[97222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:08:20 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:21 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.489s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:21 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:08:21 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Deleted volume successfully.
Nov 03 08:08:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9e5ba687-8554-49c4-9649-fe825f16237a tempest-VolumesActionsTest-1155588931 None] Lock "cinder-3399597c-260d-4fa0-b5c6-37ba7b0c1748-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:21 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-79d09d6f-eb60-4bb7-ab43-bb83334eaee4 req-99f1b790-8144-4031-b931-3de9bc2c76ab tempest-AttachVolumeNegativeTest-395788549 None] Terminate volume connection completed successfully.
Nov 03 08:08:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-79d09d6f-eb60-4bb7-ab43-bb83334eaee4 req-99f1b790-8144-4031-b931-3de9bc2c76ab tempest-AttachVolumeNegativeTest-395788549 None] Deleting attachment e6ef553d-a327-435a-a58a-6f919d9fdee7. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (37c60b18-3e42-4dc1-acf5-79612a300c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2361c081-555b-41bd-b48a-b6248d565270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2361c081-555b-41bd-b48a-b6248d565270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1976134670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b49096-22f8-40a3-951b-c79ebf11c577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:22Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cf0753-615d-40eb-8fc1-f2c47c5d08b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cf0753-615d-40eb-8fc1-f2c47c5d08b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b4f0c9-d0b9-4beb-a52b-4ebf21b4278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b4f0c9-d0b9-4beb-a52b-4ebf21b4278e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b49096-22f8-40a3-951b-c79ebf11c577', 'volume_name': 'volume-99b49096-22f8-40a3-951b-c79ebf11c577', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d21cf93-fca2-4901-86ed-0965cdb63fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d21cf93-fca2-4901-86ed-0965cdb63fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6e7c40-45dc-4a76-a677-19076eb1bd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:22 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Volume 99b49096-22f8-40a3-951b-c79ebf11c577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b49096-22f8-40a3-951b-c79ebf11c577', 'volume_size': 1}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1976134670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b49096-22f8-40a3-951b-c79ebf11c577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:22Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Creating volume 99b49096-22f8-40a3-951b-c79ebf11c577 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:22 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:22 devstack sudo[97251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577 1073741824
Nov 03 08:08:22 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:23 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577 1073741824" returned: 0 in 0.819s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:23 devstack sudo[97278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577
Nov 03 08:08:23 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:24 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577" returned: 0 in 0.379s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6e7c40-45dc-4a76-a677-19076eb1bd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b49096-22f8-40a3-951b-c79ebf11c577', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a074d4c-0cf4-4ce0-b88b-00e551a97e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:24 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Volume volume-99b49096-22f8-40a3-951b-c79ebf11c577 (99b49096-22f8-40a3-951b-c79ebf11c577): created successfully
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a074d4c-0cf4-4ce0-b88b-00e551a97e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (37c60b18-3e42-4dc1-acf5-79612a300c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:24 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0338a0c2-b68b-4320-a191-bb9afdec6c0f tempest-VolumesActionsTest-251792135 None] Created volume successfully.
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Acquiring lock "cinder-99b49096-22f8-40a3-951b-c79ebf11c577-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Lock "cinder-99b49096-22f8-40a3-951b-c79ebf11c577-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Acquiring lock "cinder-quobyte-99b49096-22f8-40a3-951b-c79ebf11c577" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Lock "cinder-quobyte-99b49096-22f8-40a3-951b-c79ebf11c577" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:25 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeb9946-7a64-4d82-b400-3600122a9445]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:08:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:25 devstack sudo[97283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577
Nov 03 08:08:25 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:25 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577" returned: 0 in 0.500s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:25 devstack sudo[97289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577
Nov 03 08:08:25 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:25 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b49096-22f8-40a3-951b-c79ebf11c577" returned: 0 in 0.335s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Lock "cinder-quobyte-99b49096-22f8-40a3-951b-c79ebf11c577" released by "delete_volume" :: held 0.889s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:25 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Created reservations ['0565fd26-5c75-4293-9323-f1494a6bcdfd', 'c9767169-5e61-425b-b303-15f4e08f9375', '1463d9d5-d946-4849-bb7e-05a4b9798e52', 'dc30d887-6e4e-47ce-8090-29ea8fadbd65'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:26 devstack sudo[97292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:08:26 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:26 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.320s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:08:26 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Deleted volume successfully.
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-be7b2aa2-e630-460a-a33f-e810f6507861 tempest-VolumesActionsTest-1155588931 None] Lock "cinder-99b49096-22f8-40a3-951b-c79ebf11c577-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (fef07834-5235-484c-a6eb-9f6d0276a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acc0b70-5516-453a-9740-ddc96c3f5abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acc0b70-5516-453a-9740-ddc96c3f5abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-29470053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db0f9fb-0225-4d76-8380-95271e3ebaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:27Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b11087-a946-4e04-9ab1-a174deee3a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b11087-a946-4e04-9ab1-a174deee3a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39e9c3c-739e-4701-a492-1ffda2946af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39e9c3c-739e-4701-a492-1ffda2946af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db0f9fb-0225-4d76-8380-95271e3ebaf1', 'volume_name': 'volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954d9081-7bab-4451-a1af-6fa71468353f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954d9081-7bab-4451-a1af-6fa71468353f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3942ad-bac1-4faa-8d63-3b9e4a6a6be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:26 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Volume 8db0f9fb-0225-4d76-8380-95271e3ebaf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1', 'volume_size': 1}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-29470053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db0f9fb-0225-4d76-8380-95271e3ebaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:27Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Creating volume 8db0f9fb-0225-4d76-8380-95271e3ebaf1 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:26 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:27 devstack sudo[97295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1 1073741824
Nov 03 08:08:27 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:27 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1 1073741824" returned: 0 in 0.596s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:27 devstack sudo[97301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1
Nov 03 08:08:27 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:28 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1" returned: 0 in 0.437s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3942ad-bac1-4faa-8d63-3b9e4a6a6be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a785dd6-76f8-4d6b-8369-318acdea10db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:28 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Volume volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1 (8db0f9fb-0225-4d76-8380-95271e3ebaf1): created successfully
Nov 03 08:08:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a785dd6-76f8-4d6b-8369-318acdea10db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (fef07834-5235-484c-a6eb-9f6d0276a713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:28 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e0ff7041-e65c-43d6-b7ed-c4dbf306bb52 tempest-VolumesActionsTest-251792135 None] Created volume successfully.
Nov 03 08:08:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Acquiring lock "cinder-8db0f9fb-0225-4d76-8380-95271e3ebaf1-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Lock "cinder-8db0f9fb-0225-4d76-8380-95271e3ebaf1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Acquiring lock "cinder-quobyte-8db0f9fb-0225-4d76-8380-95271e3ebaf1" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Lock "cinder-quobyte-8db0f9fb-0225-4d76-8380-95271e3ebaf1" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:29 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[826c6d89-1380-4143-b7dd-4d9b851d3650]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:08:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:29 devstack sudo[97304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1
Nov 03 08:08:29 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:29 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1" returned: 0 in 0.433s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:29 devstack sudo[97310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1
Nov 03 08:08:29 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:29 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8db0f9fb-0225-4d76-8380-95271e3ebaf1" returned: 0 in 0.328s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Lock "cinder-quobyte-8db0f9fb-0225-4d76-8380-95271e3ebaf1" released by "delete_volume" :: held 0.811s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Created reservations ['112ad4ac-68a2-470b-8918-4f82e44790f4', '1dba3337-e641-485f-835e-8cb7ef48edea', 'edee30d7-69f6-424f-82b2-35d4050b2e9f', '270f8f72-5735-491f-a78a-cad2d8d4ecfa'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:30 devstack sudo[97313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:08:30 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:30 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.295s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:08:30 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Deleted volume successfully.
Nov 03 08:08:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2af2b9c9-c831-40a3-82d7-5c586d1f5a6a tempest-VolumesActionsTest-1155588931 None] Lock "cinder-8db0f9fb-0225-4d76-8380-95271e3ebaf1-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (b701da3d-719d-4722-b2be-126be13490c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a54a1c6-75ab-440d-8e08-b64abebc253e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a54a1c6-75ab-440d-8e08-b64abebc253e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1695492661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff4ac27-496d-4eda-98fb-18eca365e8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:31Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fe3c55-179c-4c93-bf10-425a0c714a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fe3c55-179c-4c93-bf10-425a0c714a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3748d9e7-c450-419e-9a48-2fc2f79a9e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3748d9e7-c450-419e-9a48-2fc2f79a9e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff4ac27-496d-4eda-98fb-18eca365e8e4', 'volume_name': 'volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be583d1d-c0f2-4367-bf7e-faf33f7ae933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be583d1d-c0f2-4367-bf7e-faf33f7ae933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4949a191-4218-4adf-8bf0-af51b9dc2c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:31 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Volume 5ff4ac27-496d-4eda-98fb-18eca365e8e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4', 'volume_size': 1}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1695492661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff4ac27-496d-4eda-98fb-18eca365e8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:31Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Creating volume 5ff4ac27-496d-4eda-98fb-18eca365e8e4 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:31 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:31 devstack sudo[97316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4 1073741824
Nov 03 08:08:31 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:31 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4 1073741824" returned: 0 in 0.609s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:31 devstack sudo[97356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4
Nov 03 08:08:31 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:32 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4" returned: 0 in 0.338s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4949a191-4218-4adf-8bf0-af51b9dc2c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9dd1d8-b34c-4e1c-ad0d-7722ebfee87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:32 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Volume volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4 (5ff4ac27-496d-4eda-98fb-18eca365e8e4): created successfully
Nov 03 08:08:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9dd1d8-b34c-4e1c-ad0d-7722ebfee87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (b701da3d-719d-4722-b2be-126be13490c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:32 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-551a7d67-750c-41f5-a89f-ecda6b018e50 tempest-VolumesActionsTest-251792135 None] Created volume successfully.
Nov 03 08:08:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Acquiring lock "cinder-5ff4ac27-496d-4eda-98fb-18eca365e8e4-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Lock "cinder-5ff4ac27-496d-4eda-98fb-18eca365e8e4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Acquiring lock "cinder-quobyte-5ff4ac27-496d-4eda-98fb-18eca365e8e4" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Lock "cinder-quobyte-5ff4ac27-496d-4eda-98fb-18eca365e8e4" acquired by "delete_volume" :: waited 0.050s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:33 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aefc9db-22a5-4afa-a56e-d13fa8f81303]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:08:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:33 devstack sudo[97363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4
Nov 03 08:08:33 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:34 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4" returned: 0 in 0.530s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:34 devstack sudo[97368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4
Nov 03 08:08:34 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:34 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5ff4ac27-496d-4eda-98fb-18eca365e8e4" returned: 0 in 0.371s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Lock "cinder-quobyte-5ff4ac27-496d-4eda-98fb-18eca365e8e4" released by "delete_volume" :: held 0.968s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Created reservations ['90bfe436-7f14-44dc-99ad-96eb03066f91', '6a46c604-ab89-4380-85b3-76b3c822e6f1', '762a57a1-8d42-4b76-b1ec-ad06abd28eee', '41b003cc-1478-4aa8-a8aa-9d96d68a3a4f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:34 devstack sudo[97374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:08:34 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:35 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.350s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:35 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:08:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Deleted volume successfully.
Nov 03 08:08:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a91371b7-0eed-40be-99b3-6ee5b8753709 tempest-VolumesActionsTest-1155588931 None] Lock "cinder-5ff4ac27-496d-4eda-98fb-18eca365e8e4-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (a00fadb3-1f1b-4da8-a1c7-cf3d9132c1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d08050-3ff5-4544-95cb-883097805f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d08050-3ff5-4544-95cb-883097805f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-230979800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2407286-f772-4cc1-b314-c920b3ca75b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:37Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2418be3a-1b1c-4119-8ec6-b1a7eb93a72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2418be3a-1b1c-4119-8ec6-b1a7eb93a72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572671c2-3739-490a-9ff1-ce2b72a2ad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572671c2-3739-490a-9ff1-ce2b72a2ad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2407286-f772-4cc1-b314-c920b3ca75b1', 'volume_name': 'volume-d2407286-f772-4cc1-b314-c920b3ca75b1', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5531fc-8d44-4a80-ae55-c6059b915d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5531fc-8d44-4a80-ae55-c6059b915d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579706f7-154f-4af6-bea1-f7cacc1c6897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:36 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Volume d2407286-f772-4cc1-b314-c920b3ca75b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2407286-f772-4cc1-b314-c920b3ca75b1', 'volume_size': 1}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-230979800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2407286-f772-4cc1-b314-c920b3ca75b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc97bf334694675b2c0dc0074e46652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:37Z,use_quota=True,user_id='7ddf34101de84fc6b3a8bef444928c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Creating volume d2407286-f772-4cc1-b314-c920b3ca75b1 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:36 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:36 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1 1073741824
Nov 03 08:08:36 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:37 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1 1073741824" returned: 0 in 0.648s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:37 devstack sudo[97400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1
Nov 03 08:08:37 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:37 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1" returned: 0 in 0.340s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579706f7-154f-4af6-bea1-f7cacc1c6897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2407286-f772-4cc1-b314-c920b3ca75b1', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4940067-7beb-4233-b72a-a1493975a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:38 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Volume volume-d2407286-f772-4cc1-b314-c920b3ca75b1 (d2407286-f772-4cc1-b314-c920b3ca75b1): created successfully
Nov 03 08:08:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4940067-7beb-4233-b72a-a1493975a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Flow 'volume_create_manager' (a00fadb3-1f1b-4da8-a1c7-cf3d9132c1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:38 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5aa25168-5a8e-4b79-8a27-543cfb68bf3d tempest-VolumesActionsTest-251792135 None] Created volume successfully.
Nov 03 08:08:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Acquiring lock "cinder-d2407286-f772-4cc1-b314-c920b3ca75b1-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Lock "cinder-d2407286-f772-4cc1-b314-c920b3ca75b1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Acquiring lock "cinder-quobyte-d2407286-f772-4cc1-b314-c920b3ca75b1" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Lock "cinder-quobyte-d2407286-f772-4cc1-b314-c920b3ca75b1" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:39 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[419ae7e0-6985-4d05-84ec-da5f8a247a2e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:08:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:39 devstack sudo[97404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1
Nov 03 08:08:39 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Flow 'volume_create_manager' (a13200f7-e5be-439d-a210-4efef64a60f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4425cd-0602-41cc-82b5-fe688a2c4379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4425cd-0602-41cc-82b5-fe688a2c4379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1795801361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c867dc-9a81-4bcd-b133-ddb566f2c45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a198fe9eceea446988e623294579a63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:40Z,use_quota=True,user_id='564616cf08154347a876997700e4b1d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4e38df-1ceb-44e0-a5e6-b175920c9ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4e38df-1ceb-44e0-a5e6-b175920c9ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6522c3-71f0-411e-b0bb-cce0cc988caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6522c3-71f0-411e-b0bb-cce0cc988caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c867dc-9a81-4bcd-b133-ddb566f2c45d', 'volume_name': 'volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3a538c-315e-44e5-a911-43f808453b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3a538c-315e-44e5-a911-43f808453b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8af394e-9da3-46d7-a2df-570889d97d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:40 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Volume c4c867dc-9a81-4bcd-b133-ddb566f2c45d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d', 'volume_size': 1}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1795801361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c867dc-9a81-4bcd-b133-ddb566f2c45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a198fe9eceea446988e623294579a63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:40Z,use_quota=True,user_id='564616cf08154347a876997700e4b1d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Creating volume c4c867dc-9a81-4bcd-b133-ddb566f2c45d {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:40 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:40 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1" returned: 0 in 0.790s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:40 devstack sudo[97443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d 1073741824
Nov 03 08:08:40 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:40 devstack sudo[97447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1
Nov 03 08:08:40 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:41 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d2407286-f772-4cc1-b314-c920b3ca75b1" returned: 0 in 0.784s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Lock "cinder-quobyte-d2407286-f772-4cc1-b314-c920b3ca75b1" released by "delete_volume" :: held 1.647s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:41 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d 1073741824" returned: 0 in 0.985s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Created reservations ['5bb27dc5-6f91-4300-86a8-ff6ad3575294', '133dcfbd-82b8-4b03-9ec0-04ff109c7f45', 'ee901da7-6203-4b84-ba4e-d8ec1fcc107e', '75eee4d2-f799-4340-bca5-6237ddf14a9e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:41 devstack sudo[97483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d
Nov 03 08:08:41 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:41 devstack sudo[97485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:08:41 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:42 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" returned: 0 in 0.516s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8af394e-9da3-46d7-a2df-570889d97d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04eba3b8-c189-4b02-8fa3-f0afe9c25885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:42 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.536s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:42 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:08:42 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Volume volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d (c4c867dc-9a81-4bcd-b133-ddb566f2c45d): created successfully
Nov 03 08:08:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04eba3b8-c189-4b02-8fa3-f0afe9c25885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Flow 'volume_create_manager' (a13200f7-e5be-439d-a210-4efef64a60f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:42 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Deleted volume successfully.
Nov 03 08:08:42 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a440427d-0c1f-48a7-8efe-2ef2a42a097f tempest-TestStampPattern-361338379 None] Created volume successfully.
Nov 03 08:08:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bb0e0ea-22d2-401b-ba09-e30f463cf5a1 tempest-VolumesActionsTest-251792135 None] Lock "cinder-d2407286-f772-4cc1-b314-c920b3ca75b1-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Flow 'volume_create_manager' (53fb4d4a-9000-48a8-9f12-d70e4e6c3109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d3e7a4-0af2-48b2-8da3-9014b6317ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d3e7a4-0af2-48b2-8da3-9014b6317ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1570253346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47c7276-0be4-4f33-939f-af20dccbc9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9d952d2112f4045a60e00b9a853afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:51Z,use_quota=True,user_id='809b5ed4548b43acaf2b80bd96457beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261fe953-e0cd-4f52-9668-0adfcf498cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261fe953-e0cd-4f52-9668-0adfcf498cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea5078a-11b4-4b65-bdfb-70b707382089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea5078a-11b4-4b65-bdfb-70b707382089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47c7276-0be4-4f33-939f-af20dccbc9d4', 'volume_name': 'volume-d47c7276-0be4-4f33-939f-af20dccbc9d4', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c9c00b-2f28-4ed1-9de2-c390710265bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c9c00b-2f28-4ed1-9de2-c390710265bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d556d1e-ef1c-46fa-bb22-1f55377b822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:50 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Volume d47c7276-0be4-4f33-939f-af20dccbc9d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47c7276-0be4-4f33-939f-af20dccbc9d4', 'volume_size': 1}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1570253346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47c7276-0be4-4f33-939f-af20dccbc9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9d952d2112f4045a60e00b9a853afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:51Z,use_quota=True,user_id='809b5ed4548b43acaf2b80bd96457beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Creating volume d47c7276-0be4-4f33-939f-af20dccbc9d4 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:50 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:50 devstack sudo[97518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4 1073741824
Nov 03 08:08:50 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:51 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4 1073741824" returned: 0 in 0.816s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:51 devstack sudo[97545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4
Nov 03 08:08:51 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:52 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4" returned: 0 in 0.571s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d556d1e-ef1c-46fa-bb22-1f55377b822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47c7276-0be4-4f33-939f-af20dccbc9d4', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fc3975-211c-409f-a42a-770b4c7da96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:52 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Volume volume-d47c7276-0be4-4f33-939f-af20dccbc9d4 (d47c7276-0be4-4f33-939f-af20dccbc9d4): created successfully
Nov 03 08:08:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fc3975-211c-409f-a42a-770b4c7da96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Flow 'volume_create_manager' (53fb4d4a-9000-48a8-9f12-d70e4e6c3109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:52 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1c28ee2f-d4e3-4eb5-8936-85de648b704e tempest-VolumesTransfersTest-262326595 None] Created volume successfully.
Nov 03 08:08:54 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b005d121-40ec-49d4-aeef-805e2353ed66 tempest-VolumesTransfersTest-2026917172 None] Transfer volume completed successfully.
Nov 03 08:08:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Acquiring lock "cinder-d47c7276-0be4-4f33-939f-af20dccbc9d4-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Lock "cinder-d47c7276-0be4-4f33-939f-af20dccbc9d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Acquiring lock "cinder-quobyte-d47c7276-0be4-4f33-939f-af20dccbc9d4" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:08:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Lock "cinder-quobyte-d47c7276-0be4-4f33-939f-af20dccbc9d4" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:08:55 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[93726b0e-1c32-4f01-b380-88046df9aa23]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:08:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:55 devstack sudo[97617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4
Nov 03 08:08:55 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:55 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4" returned: 0 in 0.433s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:55 devstack sudo[97623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4
Nov 03 08:08:55 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:56 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d47c7276-0be4-4f33-939f-af20dccbc9d4" returned: 0 in 0.504s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Lock "cinder-quobyte-d47c7276-0be4-4f33-939f-af20dccbc9d4" released by "delete_volume" :: held 1.002s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Created reservations ['2d733f05-e024-4b2c-ad70-df6aa77adb70', '883e245d-8483-4b37-807e-42f09e3066c1', 'b10ac714-7179-488a-9805-e60eea8a7c54', '1b9903f1-b72f-434b-98f1-da68a689e565'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:56 devstack sudo[97626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:08:56 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:56 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.361s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:08:56 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Deleted volume successfully.
Nov 03 08:08:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95c98520-174f-40c1-ac46-24457b66fedf tempest-VolumesTransfersTest-787450199 None] Lock "cinder-d47c7276-0be4-4f33-939f-af20dccbc9d4-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Flow 'volume_create_manager' (61379bb1-fce8-477c-86ee-cfe05fe41936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efd4276-408c-4339-bc18-f00c8fa8f5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efd4276-408c-4339-bc18-f00c8fa8f5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1960818230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c97e089-e46c-490b-84ef-c5ab60d35c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9d952d2112f4045a60e00b9a853afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:58Z,use_quota=True,user_id='809b5ed4548b43acaf2b80bd96457beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da71503-ec3f-4acb-8789-c518008d00ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da71503-ec3f-4acb-8789-c518008d00ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c676db-1fa3-4102-a3b5-b38250c139f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c676db-1fa3-4102-a3b5-b38250c139f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c97e089-e46c-490b-84ef-c5ab60d35c1c', 'volume_name': 'volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063dff4f-0472-4c56-9b62-4bd012e5af2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063dff4f-0472-4c56-9b62-4bd012e5af2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ed698d-92ab-4e1c-a751-721b9d1aa497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:58 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Volume 6c97e089-e46c-490b-84ef-c5ab60d35c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c', 'volume_size': 1}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1960818230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c97e089-e46c-490b-84ef-c5ab60d35c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9d952d2112f4045a60e00b9a853afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:08:58Z,use_quota=True,user_id='809b5ed4548b43acaf2b80bd96457beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Creating volume 6c97e089-e46c-490b-84ef-c5ab60d35c1c {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:08:58 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:08:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:58 devstack sudo[97630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c 1073741824
Nov 03 08:08:58 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:59 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c 1073741824" returned: 0 in 0.681s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:08:59 devstack sudo[97637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c
Nov 03 08:08:59 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:08:59 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root
Nov 03 08:08:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c" returned: 0 in 0.345s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:08:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:08:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:08:59 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=114,cinder:SELECT=75,cinder:INSERT=19,cinder:DELETE=10 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:08:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ed698d-92ab-4e1c-a751-721b9d1aa497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc050794-8dee-44bd-b802-10eddf354e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:08:59 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Volume volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c (6c97e089-e46c-490b-84ef-c5ab60d35c1c): created successfully
Nov 03 08:08:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc050794-8dee-44bd-b802-10eddf354e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:08:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Flow 'volume_create_manager' (61379bb1-fce8-477c-86ee-cfe05fe41936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:08:59 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-22463deb-3b4a-4390-8247-fa1760126c0b tempest-VolumesTransfersTest-262326595 None] Created volume successfully.
Nov 03 08:09:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Acquiring lock "cinder-6c97e089-e46c-490b-84ef-c5ab60d35c1c-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Lock "cinder-6c97e089-e46c-490b-84ef-c5ab60d35c1c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:00 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=80,cinder:INSERT=26,cinder:UPDATE=91,cinder:DELETE=9 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:09:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Acquiring lock "cinder-quobyte-6c97e089-e46c-490b-84ef-c5ab60d35c1c" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Lock "cinder-quobyte-6c97e089-e46c-490b-84ef-c5ab60d35c1c" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:00 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c399709-756c-48e8-8fab-6b01361b274c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:00 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c
Nov 03 08:09:00 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:01 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c" returned: 0 in 0.417s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:01 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c
Nov 03 08:09:01 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:01 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c97e089-e46c-490b-84ef-c5ab60d35c1c" returned: 0 in 0.281s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Lock "cinder-quobyte-6c97e089-e46c-490b-84ef-c5ab60d35c1c" released by "delete_volume" :: held 0.776s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Created reservations ['a02b7010-0e39-4722-b88e-a2fef2d81e53', 'a95ce7c8-aa0a-4163-85bf-6e98ff2d8bb4', '1afa38f9-18d4-42f0-84c4-190dae212c40', '9c61248c-e3d5-48a9-87d3-bf57989ce743'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:01 devstack sudo[97649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:01 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:02 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.434s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:02 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Deleted volume successfully.
Nov 03 08:09:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-583b35ad-7cf3-458a-a835-7b182f76efea tempest-VolumesTransfersTest-787450199 None] Lock "cinder-6c97e089-e46c-490b-84ef-c5ab60d35c1c-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:03 devstack sudo[97652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:03 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:03 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.437s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:09:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Flow 'volume_create_manager' (addbe78e-55ec-44c6-b9ed-fd55a5d9b58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c016c9-ff73-4223-b03c-6f267855c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c016c9-ff73-4223-b03c-6f267855c69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-49701971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b064c6-9f33-42c6-8e2c-2fe47a937e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac65987e4ec4e15ab4a61acc4f8d92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:04Z,use_quota=True,user_id='778598ddb8c3449691c474702c9de725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d621268-b0b5-4993-a1a1-4101ff38161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d621268-b0b5-4993-a1a1-4101ff38161d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe0f30b-f4d5-4ed3-bc91-e33afd1b9ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe0f30b-f4d5-4ed3-bc91-e33afd1b9ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b064c6-9f33-42c6-8e2c-2fe47a937e84', 'volume_name': 'volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4ecb84-3790-4ec4-99ff-eb11acebc468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4ecb84-3790-4ec4-99ff-eb11acebc468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0908e436-90b2-42c1-bd0e-aa14c5b764ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:04 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Volume 36b064c6-9f33-42c6-8e2c-2fe47a937e84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84', 'volume_size': 1}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-49701971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b064c6-9f33-42c6-8e2c-2fe47a937e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac65987e4ec4e15ab4a61acc4f8d92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:04Z,use_quota=True,user_id='778598ddb8c3449691c474702c9de725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Creating volume 36b064c6-9f33-42c6-8e2c-2fe47a937e84 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:04 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:04 devstack sudo[97656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84 1073741824
Nov 03 08:09:04 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:05 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84 1073741824" returned: 0 in 0.497s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:05 devstack sudo[97662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84
Nov 03 08:09:05 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:05 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84" returned: 0 in 0.335s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0908e436-90b2-42c1-bd0e-aa14c5b764ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5f3753-7dba-47ec-a677-0afdcd7abfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Volume volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84 (36b064c6-9f33-42c6-8e2c-2fe47a937e84): created successfully
Nov 03 08:09:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5f3753-7dba-47ec-a677-0afdcd7abfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Flow 'volume_create_manager' (addbe78e-55ec-44c6-b9ed-fd55a5d9b58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:05 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3f866f7e-ca32-4550-ae90-984f15855b85 tempest-VolumesListAdminTestJSON-1504165294 None] Created volume successfully.
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Flow 'volume_create_manager' (8a0eaee7-bfca-4c89-8a22-de4ef2d20501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b50a8e-1596-4983-afba-bbfabca22af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b50a8e-1596-4983-afba-bbfabca22af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1595389781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a4e291-042f-4143-b582-baa51444287c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac65987e4ec4e15ab4a61acc4f8d92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:07Z,use_quota=True,user_id='778598ddb8c3449691c474702c9de725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d480fc5-3af0-454d-8212-c45d45e6e535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d480fc5-3af0-454d-8212-c45d45e6e535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee678ed-e59b-473c-be75-5c24455e8a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee678ed-e59b-473c-be75-5c24455e8a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a4e291-042f-4143-b582-baa51444287c', 'volume_name': 'volume-b2a4e291-042f-4143-b582-baa51444287c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18308cb-e156-4957-85de-c3febbe629f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18308cb-e156-4957-85de-c3febbe629f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c066114f-b09e-4802-bcb5-ebf12e4ef8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:07 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Volume b2a4e291-042f-4143-b582-baa51444287c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a4e291-042f-4143-b582-baa51444287c', 'volume_size': 1}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1595389781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a4e291-042f-4143-b582-baa51444287c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac65987e4ec4e15ab4a61acc4f8d92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:07Z,use_quota=True,user_id='778598ddb8c3449691c474702c9de725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Creating volume b2a4e291-042f-4143-b582-baa51444287c {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:07 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:07 devstack sudo[97684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c 1073741824
Nov 03 08:09:07 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Flow 'volume_create_manager' (74bc44bc-0368-4198-a95c-f0427867bf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9486ef8-54a0-4ce5-b5cf-90453a3c0f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9486ef8-54a0-4ce5-b5cf-90453a3c0f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-446555556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081efab0-e292-4571-a425-15b7d4b08abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aed085f9cf4550923d1e72500cd167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:08Z,use_quota=True,user_id='18ac9ad65aa44dae92bb70f4e039dcd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ccc8835-fd0e-410f-823e-a2a28d85193b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ccc8835-fd0e-410f-823e-a2a28d85193b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a40e6b7-6b84-4087-9275-3896ffce20fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a40e6b7-6b84-4087-9275-3896ffce20fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081efab0-e292-4571-a425-15b7d4b08abe', 'volume_name': 'volume-081efab0-e292-4571-a425-15b7d4b08abe', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b761ce12-3303-4e6b-b7fe-938c423950a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b761ce12-3303-4e6b-b7fe-938c423950a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6641cf91-9ad6-4604-b307-b673d918045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:07 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Volume 081efab0-e292-4571-a425-15b7d4b08abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081efab0-e292-4571-a425-15b7d4b08abe', 'volume_size': 1}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:07 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c 1073741824" returned: 0 in 0.494s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:07 devstack sudo[97690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c
Nov 03 08:09:07 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:08 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c" returned: 0 in 0.260s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-446555556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081efab0-e292-4571-a425-15b7d4b08abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aed085f9cf4550923d1e72500cd167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:08Z,use_quota=True,user_id='18ac9ad65aa44dae92bb70f4e039dcd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Creating volume 081efab0-e292-4571-a425-15b7d4b08abe {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:08 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c066114f-b09e-4802-bcb5-ebf12e4ef8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a4e291-042f-4143-b582-baa51444287c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:08 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe 1073741824
Nov 03 08:09:08 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973142cb-0d45-4b4f-b871-4f562cd52cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:08 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Volume volume-b2a4e291-042f-4143-b582-baa51444287c (b2a4e291-042f-4143-b582-baa51444287c): created successfully
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973142cb-0d45-4b4f-b871-4f562cd52cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Flow 'volume_create_manager' (8a0eaee7-bfca-4c89-8a22-de4ef2d20501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4548f889-f745-4017-8f55-00fe1109c89e tempest-VolumesListAdminTestJSON-1504165294 None] Created volume successfully.
Nov 03 08:09:08 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe 1073741824" returned: 0 in 0.477s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:08 devstack sudo[97698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe
Nov 03 08:09:08 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:08 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe" returned: 0 in 0.251s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6641cf91-9ad6-4604-b307-b673d918045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081efab0-e292-4571-a425-15b7d4b08abe', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923124a3-1df9-4d58-b635-af686c5af541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:08 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Volume volume-081efab0-e292-4571-a425-15b7d4b08abe (081efab0-e292-4571-a425-15b7d4b08abe): created successfully
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923124a3-1df9-4d58-b635-af686c5af541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Flow 'volume_create_manager' (74bc44bc-0368-4198-a95c-f0427867bf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-71d96f7d-41cb-4c6f-8057-e2466886bb20 tempest-AttachVolumeNegativeTest-395788549 None] Created volume successfully.
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Flow 'volume_create_manager' (0d012ff0-b21f-425e-aca1-171ac1b092f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a5e58e-9f57-40b8-b0db-8992f81cef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a5e58e-9f57-40b8-b0db-8992f81cef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-704568391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760d127b-7c00-4377-8d56-be294d0a5ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c463421aac2b4b4b8cfb618694687cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:09Z,use_quota=True,user_id='c849e16649f44bd5982530d9c2b2d1ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb577fd8-e098-4ebe-b6df-890d074f1120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb577fd8-e098-4ebe-b6df-890d074f1120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76eb100-8198-4853-92fe-bc4ebc35ba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76eb100-8198-4853-92fe-bc4ebc35ba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760d127b-7c00-4377-8d56-be294d0a5ab3', 'volume_name': 'volume-760d127b-7c00-4377-8d56-be294d0a5ab3', 'volume_size': 2}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4167d0fc-63d9-4791-b889-fc101e660fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4167d0fc-63d9-4791-b889-fc101e660fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43122b6-1a3d-402e-93ae-48f692aaf976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:09 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Volume 760d127b-7c00-4377-8d56-be294d0a5ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760d127b-7c00-4377-8d56-be294d0a5ab3', 'volume_size': 2}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-704568391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760d127b-7c00-4377-8d56-be294d0a5ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c463421aac2b4b4b8cfb618694687cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:09Z,use_quota=True,user_id='c849e16649f44bd5982530d9c2b2d1ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Creating volume 760d127b-7c00-4377-8d56-be294d0a5ab3 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:09 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3 2147483648 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:09 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3 2147483648
Nov 03 08:09:09 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Flow 'volume_create_manager' (f51c90ca-47cd-4523-9114-46bf1862e9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ac5f1a-a45d-46a3-b766-747a4adeaca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ac5f1a-a45d-46a3-b766-747a4adeaca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-768125754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfaadef5-c2dc-42ca-bc05-e5cc4d568337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac65987e4ec4e15ab4a61acc4f8d92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:10Z,use_quota=True,user_id='778598ddb8c3449691c474702c9de725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d116c8a-4168-4b5b-9ffa-995ddc18e090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d116c8a-4168-4b5b-9ffa-995ddc18e090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc116b2-d346-448d-9679-3d5a7d07d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc116b2-d346-448d-9679-3d5a7d07d40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfaadef5-c2dc-42ca-bc05-e5cc4d568337', 'volume_name': 'volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a7c385-63d9-4d39-81f5-c5e4f954894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a7c385-63d9-4d39-81f5-c5e4f954894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c95a76-8d16-4900-8c82-0af2b469cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:10 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Volume dfaadef5-c2dc-42ca-bc05-e5cc4d568337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337', 'volume_size': 1}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:10 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3 2147483648" returned: 0 in 0.623s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:10 devstack sudo[97714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3
Nov 03 08:09:10 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-bf8d5f0d-b9d6-4923-b589-b4dad91755b8 req-c76d82d5-cd95-4424-86f6-8f487b324197 tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:10 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3" returned: 0 in 0.251s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-768125754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfaadef5-c2dc-42ca-bc05-e5cc4d568337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac65987e4ec4e15ab4a61acc4f8d92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:10Z,use_quota=True,user_id='778598ddb8c3449691c474702c9de725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Creating volume dfaadef5-c2dc-42ca-bc05-e5cc4d568337 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:10 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:10 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337 1073741824
Nov 03 08:09:10 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43122b6-1a3d-402e-93ae-48f692aaf976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760d127b-7c00-4377-8d56-be294d0a5ab3', 'volume_size': 2}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7b85e5-fd09-43a0-a11e-e8b65c26ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:10 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Volume volume-760d127b-7c00-4377-8d56-be294d0a5ab3 (760d127b-7c00-4377-8d56-be294d0a5ab3): created successfully
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7b85e5-fd09-43a0-a11e-e8b65c26ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Flow 'volume_create_manager' (0d012ff0-b21f-425e-aca1-171ac1b092f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-03946f0e-7db0-4de2-9ca9-62140171b355 tempest-VolumesCloneNegativeTest-1213183566 None] Created volume successfully.
Nov 03 08:09:10 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337 1073741824" returned: 0 in 0.424s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:11 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337
Nov 03 08:09:11 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:11 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337" returned: 0 in 0.240s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-bf8d5f0d-b9d6-4923-b589-b4dad91755b8 req-c76d82d5-cd95-4424-86f6-8f487b324197 tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.792s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c95a76-8d16-4900-8c82-0af2b469cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba3d5ee-392e-4e5f-b93d-d74bf4287004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-bf8d5f0d-b9d6-4923-b589-b4dad91755b8 req-c76d82d5-cd95-4424-86f6-8f487b324197 tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:11 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Volume volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337 (dfaadef5-c2dc-42ca-bc05-e5cc4d568337): created successfully
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba3d5ee-392e-4e5f-b93d-d74bf4287004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Flow 'volume_create_manager' (f51c90ca-47cd-4523-9114-46bf1862e9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f1b59eb1-9552-463d-922c-9b71996460ee tempest-VolumesListAdminTestJSON-1504165294 None] Created volume successfully.
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-bf8d5f0d-b9d6-4923-b589-b4dad91755b8 req-c76d82d5-cd95-4424-86f6-8f487b324197 tempest-AttachVolumeNegativeTest-395788549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-081efab0-e292-4571-a425-15b7d4b08abe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa858399-7be7-4a32-88ce-455e648fda27', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:09:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-bf8d5f0d-b9d6-4923-b589-b4dad91755b8 req-c76d82d5-cd95-4424-86f6-8f487b324197 tempest-AttachVolumeNegativeTest-395788549 None] attachment_update completed successfully.
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Acquiring lock "cinder-760d127b-7c00-4377-8d56-be294d0a5ab3-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Lock "cinder-760d127b-7c00-4377-8d56-be294d0a5ab3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Acquiring lock "cinder-quobyte-760d127b-7c00-4377-8d56-be294d0a5ab3" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Lock "cinder-quobyte-760d127b-7c00-4377-8d56-be294d0a5ab3" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[45acae6e-70ff-470e-a732-cb47f555d4fd]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:12 devstack sudo[98145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3
Nov 03 08:09:12 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:12 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3" returned: 0 in 0.454s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:12 devstack sudo[98150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3
Nov 03 08:09:12 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:12 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-760d127b-7c00-4377-8d56-be294d0a5ab3" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Lock "cinder-quobyte-760d127b-7c00-4377-8d56-be294d0a5ab3" released by "delete_volume" :: held 0.783s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Created reservations ['b1c69db6-ba20-4eb5-a0de-3b40481a0f71', '6ef175d7-feb4-4ed2-8b30-89828d1a71a4', 'acefcca5-57c9-494d-ab4d-30cd7d76b7c0', '1f9147b1-6da7-41bb-9ecc-5ba6bb13726c'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:12 devstack sudo[98153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:12 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Flow 'volume_create_manager' (b9a0c2ae-1914-487a-9cc5-fbc963c9988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2828827-36fe-4022-a7d7-3819c60101c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2828827-36fe-4022-a7d7-3819c60101c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1faad1ce-d244-4903-a449-fa5eeb0c56b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560c2ac21c7f4e68a93537284aa5216e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:13Z,use_quota=True,user_id='c44522394f0a47a997c2937f059aeda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d273824b-af8b-482d-89f4-69389cda9f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d273824b-af8b-482d-89f4-69389cda9f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d508e4-1f9a-4731-a1d2-a373f9b39f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d508e4-1f9a-4731-a1d2-a373f9b39f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1faad1ce-d244-4903-a449-fa5eeb0c56b6', 'volume_name': 'volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832d9db9-daa9-49df-9c77-c677a42ece9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832d9db9-daa9-49df-9c77-c677a42ece9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b869e54f-ae32-49a7-83b6-d17a3a7b0b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:12 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Volume 1faad1ce-d244-4903-a449-fa5eeb0c56b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6', 'volume_size': 1}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1faad1ce-d244-4903-a449-fa5eeb0c56b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560c2ac21c7f4e68a93537284aa5216e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:13Z,use_quota=True,user_id='c44522394f0a47a997c2937f059aeda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Creating volume 1faad1ce-d244-4903-a449-fa5eeb0c56b6 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:12 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:12 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6 1073741824
Nov 03 08:09:12 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:13 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.361s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Deleted volume successfully.
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-44f728ea-2a1d-411a-9935-05633e75dd8c tempest-VolumesCloneNegativeTest-1213183566 None] Lock "cinder-760d127b-7c00-4377-8d56-be294d0a5ab3-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-a7a232e1-ce46-463a-9571-d12b4ebc246e req-d6775bba-3cca-4bc1-80da-282ce13809bb tempest-AttachVolumeNegativeTest-395788549 None] Terminate volume connection completed successfully.
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-a7a232e1-ce46-463a-9571-d12b4ebc246e req-d6775bba-3cca-4bc1-80da-282ce13809bb tempest-AttachVolumeNegativeTest-395788549 None] Deleting attachment fa858399-7be7-4a32-88ce-455e648fda27. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:09:13 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6 1073741824" returned: 0 in 0.708s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:13 devstack sudo[98190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6
Nov 03 08:09:13 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:13 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b869e54f-ae32-49a7-83b6-d17a3a7b0b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7b482e-22c0-4296-a8d8-bfe3d46ee055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Volume volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6 (1faad1ce-d244-4903-a449-fa5eeb0c56b6): created successfully
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7b482e-22c0-4296-a8d8-bfe3d46ee055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Flow 'volume_create_manager' (b9a0c2ae-1914-487a-9cc5-fbc963c9988d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-02e04a71-6efb-4079-873e-3d13267260af tempest-VolumesListAdminTestJSON-847975274 None] Created volume successfully.
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Acquiring lock "cinder-1faad1ce-d244-4903-a449-fa5eeb0c56b6-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Lock "cinder-1faad1ce-d244-4903-a449-fa5eeb0c56b6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Acquiring lock "cinder-quobyte-1faad1ce-d244-4903-a449-fa5eeb0c56b6" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Lock "cinder-quobyte-1faad1ce-d244-4903-a449-fa5eeb0c56b6" acquired by "delete_volume" :: waited 0.034s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[448738ea-0036-4676-93cf-b8dcf04adcbe]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "cinder-dfaadef5-c2dc-42ca-bc05-e5cc4d568337-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-dfaadef5-c2dc-42ca-bc05-e5cc4d568337-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "cinder-quobyte-dfaadef5-c2dc-42ca-bc05-e5cc4d568337" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-quobyte-dfaadef5-c2dc-42ca-bc05-e5cc4d568337" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:15 devstack sudo[98214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6
Nov 03 08:09:15 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[66485031-6fc8-4cae-afb6-31f2ae5d99d0]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:15 devstack sudo[98217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337
Nov 03 08:09:15 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:15 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6" returned: 0 in 0.566s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:16 devstack sudo[98224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6
Nov 03 08:09:16 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:16 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337" returned: 0 in 0.526s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:16 devstack sudo[98227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337
Nov 03 08:09:16 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:16 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1faad1ce-d244-4903-a449-fa5eeb0c56b6" returned: 0 in 0.396s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Lock "cinder-quobyte-1faad1ce-d244-4903-a449-fa5eeb0c56b6" released by "delete_volume" :: held 1.067s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Created reservations ['1a5ddb6e-1f0b-4d05-b3a2-a8ea04b5b448', 'afbf47e2-b9e0-468f-b599-f532342ac48d', 'eddeed68-f341-4c28-a344-e750fba1b0f4', '99a7e81c-860f-416a-a97c-842f12428649'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:16 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-dfaadef5-c2dc-42ca-bc05-e5cc4d568337" returned: 0 in 0.439s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-quobyte-dfaadef5-c2dc-42ca-bc05-e5cc4d568337" released by "delete_volume" :: held 1.044s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:16 devstack sudo[98233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:16 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Created reservations ['68da2ee1-370c-4028-9226-052368edf467', '24040b5d-792a-431c-9457-0dcd0bbdfc10', '97117841-b60b-4946-80a4-b0d6ff1a72e3', '75a3de72-f1aa-42b7-ada5-6a8f5f4026d8'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:16 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:16 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:16 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.335s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Deleted volume successfully.
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-258b4ee5-e326-4976-9483-fcf83a08abe6 tempest-VolumesListAdminTestJSON-847975274 None] Lock "cinder-1faad1ce-d244-4903-a449-fa5eeb0c56b6-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:17 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.321s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Deleted volume successfully.
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c11b6113-aa1c-407c-8fc3-76089583160b tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-dfaadef5-c2dc-42ca-bc05-e5cc4d568337-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "cinder-b2a4e291-042f-4143-b582-baa51444287c-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-b2a4e291-042f-4143-b582-baa51444287c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "cinder-quobyte-b2a4e291-042f-4143-b582-baa51444287c" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-quobyte-b2a4e291-042f-4143-b582-baa51444287c" acquired by "delete_volume" :: waited 0.043s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[12795c74-78d2-473e-a747-e5c16ec8c952]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:18 devstack sudo[98246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c
Nov 03 08:09:18 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (b1e0876a-843f-4b73-975e-8b48b5de32c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5910cf-2e2a-4dc8-a1f9-93549aedeacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:18 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5910cf-2e2a-4dc8-a1f9-93549aedeacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1676434179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4c0500-221b-4644-b2fc-8dbb4e2f6a35,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:18Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f3937c-cc70-4976-89cf-1cbb67a91374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f3937c-cc70-4976-89cf-1cbb67a91374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18045d19-4479-4ebd-93a7-dc60c644257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18045d19-4479-4ebd-93a7-dc60c644257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb4c0500-221b-4644-b2fc-8dbb4e2f6a35', 'volume_name': 'volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f3b2e4-fc25-45f4-9707-d9f3511ab0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f3b2e4-fc25-45f4-9707-d9f3511ab0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243c3725-2775-49d9-a143-d491cde9dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:18 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Volume eb4c0500-221b-4644-b2fc-8dbb4e2f6a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35', 'volume_size': 1}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1676434179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4c0500-221b-4644-b2fc-8dbb4e2f6a35,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:18Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Creating volume eb4c0500-221b-4644-b2fc-8dbb4e2f6a35 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:18 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c" returned: 0 in 0.459s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:18 devstack sudo[98253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35 1073741824
Nov 03 08:09:18 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:18 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c
Nov 03 08:09:18 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:18 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b2a4e291-042f-4143-b582-baa51444287c" returned: 0 in 0.277s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-quobyte-b2a4e291-042f-4143-b582-baa51444287c" released by "delete_volume" :: held 0.796s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Created reservations ['9b6ea3ee-7c90-41ea-a10c-f07b38534315', '0f6e7f75-629d-4ac0-b087-f6f80d862695', 'd4919576-6e41-4b55-958b-c91b8105c678', '994d421f-41d3-4fd0-b146-88c538978bd8'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:18 devstack sudo[98266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:18 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:18 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35 1073741824" returned: 0 in 0.609s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:19 devstack sudo[98268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35
Nov 03 08:09:19 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "cinder-36b064c6-9f33-42c6-8e2c-2fe47a937e84-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-36b064c6-9f33-42c6-8e2c-2fe47a937e84-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "cinder-quobyte-36b064c6-9f33-42c6-8e2c-2fe47a937e84" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-quobyte-36b064c6-9f33-42c6-8e2c-2fe47a937e84" acquired by "delete_volume" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:19 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.513s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[413fa005-38ce-4e83-806f-65fee4309e13]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:19 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Deleted volume successfully.
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-879badd6-1974-4162-883f-7ccaca6e3f62 tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-b2a4e291-042f-4143-b582-baa51444287c-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:19 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35" returned: 0 in 0.397s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243c3725-2775-49d9-a143-d491cde9dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61fd811-1dd6-4e6d-8f77-7aa32bee0e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:19 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Volume volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35 (eb4c0500-221b-4644-b2fc-8dbb4e2f6a35): created successfully
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61fd811-1dd6-4e6d-8f77-7aa32bee0e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (b1e0876a-843f-4b73-975e-8b48b5de32c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:19 devstack sudo[98275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84
Nov 03 08:09:19 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:19 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-03185e6e-257f-47b0-a9e0-5ff0d531171b tempest-VolumesGetTest-696480383 None] Created volume successfully.
Nov 03 08:09:19 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84" returned: 0 in 0.447s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:19 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84
Nov 03 08:09:19 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "cinder-081efab0-e292-4571-a425-15b7d4b08abe-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-081efab0-e292-4571-a425-15b7d4b08abe-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-a8af0222-a114-402b-a801-d1b9f12820db req-1ef4a523-8604-4602-a09d-f371cdf18224 tempest-TestStampPattern-361338379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-a8af0222-a114-402b-a801-d1b9f12820db req-1ef4a523-8604-4602-a09d-f371cdf18224 tempest-TestStampPattern-361338379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-a8af0222-a114-402b-a801-d1b9f12820db req-1ef4a523-8604-4602-a09d-f371cdf18224 tempest-TestStampPattern-361338379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "cinder-quobyte-081efab0-e292-4571-a425-15b7d4b08abe" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-quobyte-081efab0-e292-4571-a425-15b7d4b08abe" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-a8af0222-a114-402b-a801-d1b9f12820db req-1ef4a523-8604-4602-a09d-f371cdf18224 tempest-TestStampPattern-361338379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '186ee94a-bf7c-486d-8f9a-5cdd4f8377d0', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87fc221-c8bd-4c0e-bc82-c18a579f477d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:20 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-36b064c6-9f33-42c6-8e2c-2fe47a937e84" returned: 0 in 0.302s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-quobyte-36b064c6-9f33-42c6-8e2c-2fe47a937e84" released by "delete_volume" :: held 0.827s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:20 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-a8af0222-a114-402b-a801-d1b9f12820db req-1ef4a523-8604-4602-a09d-f371cdf18224 tempest-TestStampPattern-361338379 None] attachment_update completed successfully.
Nov 03 08:09:20 devstack sudo[98291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe
Nov 03 08:09:20 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Created reservations ['c214fb5c-8b43-48ab-8217-b83cabe98cc2', '058967c9-6d25-4368-8fac-0dcc2bbdc6f2', 'd11d964b-addc-4f58-b3de-9c2618ca5049', '6d11ce3f-93b6-43f8-b216-fae9a8aac0a3'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:20 devstack sudo[98367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:20 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:20 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe" returned: 0 in 0.501s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:20 devstack sudo[98399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe
Nov 03 08:09:20 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:20 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.466s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:20 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Deleted volume successfully.
Nov 03 08:09:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ff59572-df13-4dbf-bead-f83a6a3865cd tempest-VolumesListAdminTestJSON-1504165294 None] Lock "cinder-36b064c6-9f33-42c6-8e2c-2fe47a937e84-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:21 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-081efab0-e292-4571-a425-15b7d4b08abe" returned: 0 in 0.552s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-quobyte-081efab0-e292-4571-a425-15b7d4b08abe" released by "delete_volume" :: held 1.111s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Created reservations ['dd304140-285f-468e-82bf-ee28c8be637e', '125034ab-99c6-422a-b2b2-fa73faf82edb', '1c381059-0f7a-43f6-9074-dcdc15ecdc2a', '2fb2a14d-ef7a-4aaa-8bb1-1e3c4209367b'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:21 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:21 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (6fa521f2-0870-42bc-9808-bc57bfcba521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e570ce9c-6dd1-4048-8f1f-8dab1a56a3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e570ce9c-6dd1-4048-8f1f-8dab1a56a3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-197714932',display_name='tempest-VolumesGetTest-Volume-1454940405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d35c94-c602-461e-8ac8-4defc69a2b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:22Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60eef8d9-88e8-46ce-aefb-3c20aa55f4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60eef8d9-88e8-46ce-aefb-3c20aa55f4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad66c0d-0138-4f5a-acae-ebdc1f53ae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad66c0d-0138-4f5a-acae-ebdc1f53ae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d35c94-c602-461e-8ac8-4defc69a2b08', 'volume_name': 'volume-44d35c94-c602-461e-8ac8-4defc69a2b08', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16d21b2-ccdf-41ce-bee2-e3ef635056b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16d21b2-ccdf-41ce-bee2-e3ef635056b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:21 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9aa352-026b-46d4-9676-305ae6029102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:21 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Volume 44d35c94-c602-461e-8ac8-4defc69a2b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d35c94-c602-461e-8ac8-4defc69a2b08', 'volume_size': 1}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-197714932',display_name='tempest-VolumesGetTest-Volume-1454940405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d35c94-c602-461e-8ac8-4defc69a2b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:22Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Creating volume 44d35c94-c602-461e-8ac8-4defc69a2b08 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:21 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.352s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:21 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Deleted volume successfully.
Nov 03 08:09:21 devstack sudo[98728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08 1073741824
Nov 03 08:09:21 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-95991b5d-8057-4b24-9431-87a970d23f15 tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-081efab0-e292-4571-a425-15b7d4b08abe-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "cinder-50375dfb-eef8-4cb5-a841-99e6bb4d919e-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-50375dfb-eef8-4cb5-a841-99e6bb4d919e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:22 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08 1073741824" returned: 0 in 0.710s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "cinder-quobyte-50375dfb-eef8-4cb5-a841-99e6bb4d919e" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-quobyte-50375dfb-eef8-4cb5-a841-99e6bb4d919e" acquired by "delete_volume" :: waited 0.038s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e099aa-4468-4e3c-ba58-8418fcb63b70]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:22 devstack sudo[98745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08
Nov 03 08:09:22 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:22 devstack sudo[98746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e
Nov 03 08:09:22 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:22 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9aa352-026b-46d4-9676-305ae6029102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d35c94-c602-461e-8ac8-4defc69a2b08', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90c6e36-39c0-4fd7-9e4e-a9b1baa4edc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:22 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Volume volume-44d35c94-c602-461e-8ac8-4defc69a2b08 (44d35c94-c602-461e-8ac8-4defc69a2b08): created successfully
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90c6e36-39c0-4fd7-9e4e-a9b1baa4edc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (6fa521f2-0870-42bc-9808-bc57bfcba521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2d1c4fe3-5332-4855-8d6b-0cf08e7e2ad5 tempest-VolumesGetTest-696480383 None] Created volume successfully.
Nov 03 08:09:23 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e" returned: 0 in 0.476s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:23 devstack sudo[98753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e
Nov 03 08:09:23 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:23 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-50375dfb-eef8-4cb5-a841-99e6bb4d919e" returned: 0 in 0.291s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-quobyte-50375dfb-eef8-4cb5-a841-99e6bb4d919e" released by "delete_volume" :: held 0.841s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Created reservations ['d3937385-6fbe-43f0-9bd8-772e36b0e904', '3c7947a7-5a65-4965-ae58-4e863433519d', 'cc8734d2-b949-4894-b4b3-1a80d50c018d', '2598612b-fada-409a-ad1d-8ed9b70b1bcf'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:23 devstack sudo[98756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:23 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:23 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.307s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Deleted volume successfully.
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85acfb3d-fd98-4b04-8b1c-dfc13c9381a0 tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-50375dfb-eef8-4cb5-a841-99e6bb4d919e-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-44d35c94-c602-461e-8ac8-4defc69a2b08-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Lock "cinder-44d35c94-c602-461e-8ac8-4defc69a2b08-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "cinder-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-quobyte-44d35c94-c602-461e-8ac8-4defc69a2b08" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-44d35c94-c602-461e-8ac8-4defc69a2b08" acquired by "delete_volume" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "cinder-quobyte-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[335b067c-4fa4-4710-a2cb-f2d29a90a969]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-quobyte-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986" acquired by "delete_volume" :: waited 0.036s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7873da-21e1-4866-aa02-97270bf77f0e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:24 devstack sudo[98760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08
Nov 03 08:09:24 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:24 devstack sudo[98761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986
Nov 03 08:09:24 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:24 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08" returned: 0 in 0.468s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:24 devstack sudo[98768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08
Nov 03 08:09:24 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:24 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986" returned: 0 in 0.513s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:24 devstack sudo[98775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986
Nov 03 08:09:24 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:24 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-44d35c94-c602-461e-8ac8-4defc69a2b08" returned: 0 in 0.317s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-44d35c94-c602-461e-8ac8-4defc69a2b08" released by "delete_volume" :: held 0.854s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Created reservations ['350f244b-2a00-4ec3-9333-ef1a3cd68fa8', '951c97ca-6081-4837-92cb-5f82ded803fb', '9854e7d5-62e7-46ab-a893-4c46fdf21539', '4d698547-ddb9-408a-beba-7455e1463a66'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:24 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986" returned: 0 in 0.304s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-quobyte-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986" released by "delete_volume" :: held 0.906s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:25 devstack sudo[98786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:25 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Created reservations ['e8cf54b8-90bc-4af1-9bcd-7f83f8841a1a', '4fac198d-4a8d-4a91-91d7-e04f42957e7a', '9248a423-6f54-40f9-a5d7-d24b8029777e', 'cb812119-d441-46eb-a4e5-cff30ecd229e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:25 devstack sudo[98790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:25 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Lock "cinder-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-quobyte-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a4e174-c009-4a7e-933f-f4de6051dcf7]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:25 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.440s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Deleted volume successfully.
Nov 03 08:09:25 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f4171e33-bb59-4651-a9e2-3dfe0deff581 tempest-VolumesGetTest-696480383 None] Lock "cinder-44d35c94-c602-461e-8ac8-4defc69a2b08-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.321s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Deleted volume successfully.
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2ff2f065-fbb4-4dc8-b1fe-057acbd98caf tempest-AttachVolumeNegativeTest-395788549 None] Lock "cinder-8aa8d0d6-0cbb-4ba7-9c3c-c570e2236986-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:25 devstack sudo[98794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35
Nov 03 08:09:25 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:25 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35" returned: 0 in 0.467s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:25 devstack sudo[98799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35
Nov 03 08:09:25 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:26 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-25dcea0b-f41a-42b6-b530-789bbc982bd5 req-efe9b161-41b7-4f01-8d0a-b79b8388c81b tempest-TestStampPattern-361338379 None] Terminate volume connection completed successfully.
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-25dcea0b-f41a-42b6-b530-789bbc982bd5 req-efe9b161-41b7-4f01-8d0a-b79b8388c81b tempest-TestStampPattern-361338379 None] Deleting attachment 186ee94a-bf7c-486d-8f9a-5cdd4f8377d0. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:09:26 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35" returned: 0 in 0.345s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35" released by "delete_volume" :: held 0.893s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Created reservations ['3f54fb5a-f8f3-40a0-819d-55bfc808d028', '0c4ee90f-4de6-4f83-b067-18bec2830888', '187300a8-c7b4-4fc7-9a1a-68706511ae58', '34978200-857e-405e-a18f-6d8b8b230d54'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:26 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:09:26 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:26 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.341s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:09:26 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Deleted volume successfully.
Nov 03 08:09:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29ced768-8654-4268-b2ea-cad172309cca tempest-VolumesGetTest-696480383 None] Lock "cinder-eb4c0500-221b-4644-b2fc-8dbb4e2f6a35-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (c424555d-209f-49b3-b3c0-ad156114db94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d824e6-7513-4959-a079-ee2f2bd8c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d824e6-7513-4959-a079-ee2f2bd8c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-338436070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93787f02-fbc6-4a45-8ed5-2bd114a7ea05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:27Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344721a6-f46c-4211-a4d5-56886fedf705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344721a6-f46c-4211-a4d5-56886fedf705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ad7282-ed4c-4041-8a69-3faf31c5d1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ad7282-ed4c-4041-8a69-3faf31c5d1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93787f02-fbc6-4a45-8ed5-2bd114a7ea05', 'volume_name': 'volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b02c68c-b756-4606-a938-86966df9a64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b02c68c-b756-4606-a938-86966df9a64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f2b5b0-e38a-4751-be62-7318a97d6c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:27 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Volume 93787f02-fbc6-4a45-8ed5-2bd114a7ea05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05', 'volume_size': 1}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-338436070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93787f02-fbc6-4a45-8ed5-2bd114a7ea05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:27Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Creating volume 93787f02-fbc6-4a45-8ed5-2bd114a7ea05 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:27 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:27 devstack sudo[98832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 1073741824
Nov 03 08:09:27 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:27 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 1073741824" returned: 0 in 0.493s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:27 devstack sudo[98838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05
Nov 03 08:09:27 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:28 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05" returned: 0 in 0.377s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.842s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Creating offline snapshot db3a4119-45f6-4589-9d48-1dd825d7ad56 of volume c4c867dc-9a81-4bcd-b133-ddb566f2c45d {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f2b5b0-e38a-4751-be62-7318a97d6c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed40eb0e-1edd-46b0-8c95-b869a821adc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7a12f0-8872-4fa1-87e6-8f026f976368]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:28 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Volume volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 (93787f02-fbc6-4a45-8ed5-2bd114a7ea05): created successfully
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed40eb0e-1edd-46b0-8c95-b869a821adc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (c424555d-209f-49b3-b3c0-ad156114db94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:28 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-42abeb94-c76d-4854-9dbd-719bb4dfd943 tempest-VolumesGetTest-696480383 None] Created volume successfully.
Nov 03 08:09:28 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d
Nov 03 08:09:28 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:28 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" returned: 0 in 0.443s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:28 devstack sudo[98847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 1G
Nov 03 08:09:28 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:29 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 1G" returned: 0 in 0.454s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:29 devstack sudo[98853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56
Nov 03 08:09:29 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:29 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56" returned: 0 in 0.394s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:29 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 is being set with open permissions: ugo+rw
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:29 devstack sudo[98859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56
Nov 03 08:09:29 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:29 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56" returned: 0 in 0.275s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (c3b7fa6e-dc68-4d2e-9df0-d41da36c1346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead27abc-06b8-4954-80d4-f3f58bc826fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead27abc-06b8-4954-80d4-f3f58bc826fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-164515110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645d0b5b-a47d-4b04-b985-ff2a2749105f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=93787f02-fbc6-4a45-8ed5-2bd114a7ea05,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:30Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c53157-1fde-4e82-aa0f-3802760ba7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c53157-1fde-4e82-aa0f-3802760ba7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43612060-74ad-4edb-97f2-cb222d411b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43612060-74ad-4edb-97f2-cb222d411b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '645d0b5b-a47d-4b04-b985-ff2a2749105f', 'volume_name': 'volume-645d0b5b-a47d-4b04-b985-ff2a2749105f', 'volume_size': 1, 'source_volid': '93787f02-fbc6-4a45-8ed5-2bd114a7ea05', 'source_volstatus': 'available'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:29 devstack sudo[98862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.info
Nov 03 08:09:29 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7118773-b0ed-4f1b-bc0f-f52ebb0e584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7118773-b0ed-4f1b-bc0f-f52ebb0e584f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58584b83-870a-4f99-bffa-fd27b930b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:29 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Volume 645d0b5b-a47d-4b04-b985-ff2a2749105f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-645d0b5b-a47d-4b04-b985-ff2a2749105f', 'volume_size': 1, 'source_volid': '93787f02-fbc6-4a45-8ed5-2bd114a7ea05', 'source_volstatus': 'available'}
Nov 03 08:09:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:30 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.info" returned: 0 in 0.263s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:30 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.info is being set with open permissions: ugo+rw
Nov 03 08:09:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:30 devstack sudo[98865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.info
Nov 03 08:09:30 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:30 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.info" returned: 0 in 0.354s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.372s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.588s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:30 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Cloning volume 93787f02-fbc6-4a45-8ed5-2bd114a7ea05 to volume 645d0b5b-a47d-4b04-b985-ff2a2749105f
Nov 03 08:09:30 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8b3e2a41-5841-438d-baa8-fd18650f3c02 tempest-TestStampPattern-361338379 None] Create snapshot completed successfully
Nov 03 08:09:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Creating offline snapshot 05daa9fb-ae28-45e8-af38-972a71590f5e of volume 93787f02-fbc6-4a45-8ed5-2bd114a7ea05 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:09:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aa4bca-4882-4727-bbda-1b6c710a5c97]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:30 devstack sudo[98868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05
Nov 03 08:09:30 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:30 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Flow 'volume_create_manager' (b7c0e4cd-f091-4975-8603-36aa319a3742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16568c33-4dbb-40ea-a130-ddaa9ae676d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16568c33-4dbb-40ea-a130-ddaa9ae676d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-698760127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52ed0fc-359b-46fc-a4f4-e2dd1e675f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc77f735ef458ab45e28809ae5c6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:31Z,use_quota=True,user_id='0a9524221f1e4903bfc9b815f2562f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f347281d-4237-4484-8298-da41669e2891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f347281d-4237-4484-8298-da41669e2891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de99159-f874-40e7-83f3-d919ca272761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de99159-f874-40e7-83f3-d919ca272761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd52ed0fc-359b-46fc-a4f4-e2dd1e675f67', 'volume_name': 'volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28d919f-e89c-4890-944e-53c624ebcf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28d919f-e89c-4890-944e-53c624ebcf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8156be0-bfa9-407a-bad8-a8271cb5456d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:31 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Volume d52ed0fc-359b-46fc-a4f4-e2dd1e675f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67', 'volume_size': 1}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:31 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05" returned: 0 in 0.476s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:31 devstack sudo[98873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e 1G
Nov 03 08:09:31 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:31 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e 1G" returned: 0 in 0.482s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:31 devstack sudo[98880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e
Nov 03 08:09:31 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:31 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e" returned: 0 in 0.332s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:31 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e is being set with open permissions: ugo+rw
Nov 03 08:09:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:31 devstack sudo[98885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e
Nov 03 08:09:31 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:32 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e" returned: 0 in 0.330s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:32 devstack sudo[98888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.info
Nov 03 08:09:32 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:32 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.info" returned: 0 in 0.358s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:32 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.info is being set with open permissions: ugo+rw
Nov 03 08:09:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:32 devstack sudo[98925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.info
Nov 03 08:09:32 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:33 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.info" returned: 0 in 0.383s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-quobyte-645d0b5b-a47d-4b04-b985-ff2a2749105f" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-645d0b5b-a47d-4b04-b985-ff2a2749105f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] snapshot: 05daa9fb-ae28-45e8-af38-972a71590f5e, volume: 645d0b5b-a47d-4b04-b985-ff2a2749105f,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2afef9-cfad-471f-a396-8ff3a243f479]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:33 devstack sudo[98930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e
Nov 03 08:09:33 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:33 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e" returned: 0 in 0.398s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3929b190-ab20-4316-8216-eb56f87805ca]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:33 devstack sudo[98940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05
Nov 03 08:09:33 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:34 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05" returned: 0 in 0.439s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:09:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:09:34 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:09:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:34 devstack sudo[98957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f
Nov 03 08:09:34 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:41 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f" returned: 0 in 7.944s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:41 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:09:41 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Converted 1024.00 MB image at 128.87 MB/s
Nov 03 08:09:41 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f is being set with open permissions: ugo+rw
Nov 03 08:09:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:41 devstack sudo[98978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f
Nov 03 08:09:41 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:42 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f" returned: 0 in 0.276s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-645d0b5b-a47d-4b04-b985-ff2a2749105f" released by "_copy_volume_from_snapshot" :: held 9.148s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-quobyte-05daa9fb-ae28-45e8-af38-972a71590f5e" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=101,cinder:INSERT=29,cinder:UPDATE=117,cinder:DELETE=10 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-05daa9fb-ae28-45e8-af38-972a71590f5e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Deleting offline snapshot 05daa9fb-ae28-45e8-af38-972a71590f5e of volume 93787f02-fbc6-4a45-8ed5-2bd114a7ea05 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] snapshot_file for this snap is: volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01e87b7-d9df-4e48-8027-9fd8367454af]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Flow 'volume_create_manager' (4447447e-436c-41e1-bf91-839c7a329fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff7569f-11b2-43a5-9f91-e6fcbbd7cebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff7569f-11b2-43a5-9f91-e6fcbbd7cebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2128364957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a089b6-1ab6-4abe-9369-3acddd166052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a198fe9eceea446988e623294579a63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db3a4119-45f6-4589-9d48-1dd825d7ad56,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:42Z,use_quota=True,user_id='564616cf08154347a876997700e4b1d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3c3ec8-3d40-4af7-8c86-907aa8c25c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3c3ec8-3d40-4af7-8c86-907aa8c25c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e681829-8ad5-4549-a174-1f0d37c47dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e681829-8ad5-4549-a174-1f0d37c47dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69a089b6-1ab6-4abe-9369-3acddd166052', 'volume_name': 'volume-69a089b6-1ab6-4abe-9369-3acddd166052', 'volume_size': 1, 'snapshot_id': 'db3a4119-45f6-4589-9d48-1dd825d7ad56'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:42 devstack sudo[98981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1213d6fa-a682-4e50-b890-532255386372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:42 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1213d6fa-a682-4e50-b890-532255386372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1eb376-ffff-4634-bf20-12ccf32c19ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:42 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Volume 69a089b6-1ab6-4abe-9369-3acddd166052: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69a089b6-1ab6-4abe-9369-3acddd166052', 'volume_size': 1, 'snapshot_id': 'db3a4119-45f6-4589-9d48-1dd825d7ad56'}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:42 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e" returned: 0 in 0.438s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb419e5-af17-45e3-a7bb-86013f9f6bfe]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:42 devstack sudo[98986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05
Nov 03 08:09:42 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-006ae374-3344-45ca-bf0b-6df468264931 tempest-GroupsTest-984456582 None] Group tempest-Group1-1018820390: creating
Nov 03 08:09:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-006ae374-3344-45ca-bf0b-6df468264931 tempest-GroupsTest-984456582 None] Group tempest-Group1-1018820390: created successfully
Nov 03 08:09:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-006ae374-3344-45ca-bf0b-6df468264931 tempest-GroupsTest-984456582 None] Create group completed successfully.
Nov 03 08:09:43 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05" returned: 0 in 0.605s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:43 devstack sudo[98994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e
Nov 03 08:09:43 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:43 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e" returned: 0 in 0.351s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:43 devstack sudo[99001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e
Nov 03 08:09:43 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:44 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05.05daa9fb-ae28-45e8-af38-972a71590f5e" returned: 0 in 0.265s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-05daa9fb-ae28-45e8-af38-972a71590f5e" released by "_delete_snapshot" :: held 1.815s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.588s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.047s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-698760127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52ed0fc-359b-46fc-a4f4-e2dd1e675f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc77f735ef458ab45e28809ae5c6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:31Z,use_quota=True,user_id='0a9524221f1e4903bfc9b815f2562f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Creating volume d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:44 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58584b83-870a-4f99-bffa-fd27b930b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645d0b5b-a47d-4b04-b985-ff2a2749105f', 'volume_size': 1, 'source_volid': '93787f02-fbc6-4a45-8ed5-2bd114a7ea05', 'source_volstatus': 'available'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:44 devstack sudo[99004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 1073741824
Nov 03 08:09:44 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cafe93-e810-4da8-82a0-42b33e15de48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:44 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Volume volume-645d0b5b-a47d-4b04-b985-ff2a2749105f (645d0b5b-a47d-4b04-b985-ff2a2749105f): created successfully
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cafe93-e810-4da8-82a0-42b33e15de48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (c3b7fa6e-dc68-4d2e-9df0-d41da36c1346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:44 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-88bddeff-2a68-426a-9362-2c10b18e5860 tempest-VolumesGetTest-696480383 None] Created volume successfully.
Nov 03 08:09:44 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4e766cf7-df6b-489f-990e-60e8be4b4f59 tempest-GroupsTest-984456582 None] Group tempest-Group2-93438693: creating
Nov 03 08:09:44 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4e766cf7-df6b-489f-990e-60e8be4b4f59 tempest-GroupsTest-984456582 None] Group tempest-Group2-93438693: created successfully
Nov 03 08:09:44 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4e766cf7-df6b-489f-990e-60e8be4b4f59 tempest-GroupsTest-984456582 None] Create group completed successfully.
Nov 03 08:09:44 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 1073741824" returned: 0 in 0.600s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:44 devstack sudo[99010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67
Nov 03 08:09:44 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:45 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" returned: 0 in 0.379s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.686s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Acquiring lock "cinder-quobyte-db3a4119-45f6-4589-9d48-1dd825d7ad56-69a089b6-1ab6-4abe-9369-3acddd166052" by "_create_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8156be0-bfa9-407a-bad8-a8271cb5456d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5982477b-7ce2-4e1a-bd28-af483f139d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-db3a4119-45f6-4589-9d48-1dd825d7ad56-69a089b6-1ab6-4abe-9369-3acddd166052" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Creating volume 69a089b6-1ab6-4abe-9369-3acddd166052 from snapshot db3a4119-45f6-4589-9d48-1dd825d7ad56 {{(pid=86851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Acquiring lock "cinder-quobyte-69a089b6-1ab6-4abe-9369-3acddd166052" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:09:45 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Volume volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 (d52ed0fc-359b-46fc-a4f4-e2dd1e675f67): created successfully
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5982477b-7ce2-4e1a-bd28-af483f139d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Flow 'volume_create_manager' (b7c0e4cd-f091-4975-8603-36aa319a3742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-69a089b6-1ab6-4abe-9369-3acddd166052" acquired by "_copy_volume_from_snapshot" :: waited 0.086s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] snapshot: db3a4119-45f6-4589-9d48-1dd825d7ad56, volume: 69a089b6-1ab6-4abe-9369-3acddd166052,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:09:45 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9425f363-6284-4487-8480-8095a89b7c30 tempest-SnapshotMetadataTestJSON-105688393 None] Created volume successfully.
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9948da6-ac7a-40f9-b24c-a4bfa576ce69]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:45 devstack sudo[99013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56
Nov 03 08:09:45 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (d707b661-97fa-4570-9d79-f6ed0d708095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6142cbb-8476-48df-863d-a8443300e2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6142cbb-8476-48df-863d-a8443300e2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1679633803',display_name='tempest-VolumesGetTest-Volume-1615268937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd89a9c-b393-4607-af1b-913f5448f06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:46Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:46 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fa9ec0-eb61-44a8-b44a-bbd7ff84eb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fa9ec0-eb61-44a8-b44a-bbd7ff84eb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6c6fb4-06cf-49a9-9023-b53b917fd518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6c6fb4-06cf-49a9-9023-b53b917fd518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd89a9c-b393-4607-af1b-913f5448f06b', 'volume_name': 'volume-7bd89a9c-b393-4607-af1b-913f5448f06b', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2818391-3c36-4840-b2e2-666a319a7546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2818391-3c36-4840-b2e2-666a319a7546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce82927e-34a4-416b-9918-dc9daefa01c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:46 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Volume 7bd89a9c-b393-4607-af1b-913f5448f06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd89a9c-b393-4607-af1b-913f5448f06b', 'volume_size': 1}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56" returned: 0 in 0.907s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[12681b85-c543-4232-bd78-06d1eba0269c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:46 devstack sudo[99018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d
Nov 03 08:09:46 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Flow 'volume_create_manager' (f9fff4e7-8943-4475-bd85-40c2edb92379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f4d922-64a1-4a80-8951-e05e966ba52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f4d922-64a1-4a80-8951-e05e966ba52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1580273832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d6d742c8-ac2b-4df7-9642-270429f1879d,host='devstack@QuobyteHD#QuobyteHD',id=2898785c-fec4-4d7d-ab83-e1ff110b8ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aea505933574e618498e86a848409a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:47Z,use_quota=True,user_id='dc133919df7247a79a5b05417c3ba712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b884e68-4d02-432e-825c-02fd2dfab449),volume_type_id=9b884e68-4d02-432e-825c-02fd2dfab449)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:47 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a1a30c-b922-4069-a203-77df507410d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a1a30c-b922-4069-a203-77df507410d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eaf0e9e-0ad8-45f0-a516-5b467f7984a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eaf0e9e-0ad8-45f0-a516-5b467f7984a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2898785c-fec4-4d7d-ab83-e1ff110b8ea9', 'volume_name': 'volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6fb934-1419-4089-86ed-dc740d9b13b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6fb934-1419-4089-86ed-dc740d9b13b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbb646e-dac7-40d9-9088-eb556274832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:47 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Volume 2898785c-fec4-4d7d-ab83-e1ff110b8ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9', 'volume_size': 1}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" returned: 0 in 0.674s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052 not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:09:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:47 devstack sudo[99023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052
Nov 03 08:09:47 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052" returned: 0 in 9.698s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:56 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d, size 1024.00 MB, duration 9.70 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:09:56 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Converted 1024.00 MB image at 105.58 MB/s
Nov 03 08:09:56 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052 is being set with open permissions: ugo+rw
Nov 03 08:09:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:56 devstack sudo[99105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052
Nov 03 08:09:56 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:56 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=104,cinder:INSERT=29,cinder:UPDATE=135,cinder:DELETE=11 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:09:57 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052" returned: 0 in 0.310s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-69a089b6-1ab6-4abe-9369-3acddd166052" released by "_copy_volume_from_snapshot" :: held 11.805s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-db3a4119-45f6-4589-9d48-1dd825d7ad56-69a089b6-1ab6-4abe-9369-3acddd166052" released by "_create_volume_from_snapshot" :: held 11.962s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.368s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Creating offline snapshot cb356373-861b-4005-8d41-1b832bbb6b3c of volume d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1eb376-ffff-4634-bf20-12ccf32c19ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a089b6-1ab6-4abe-9369-3acddd166052', 'volume_size': 1, 'snapshot_id': 'db3a4119-45f6-4589-9d48-1dd825d7ad56'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5535f84c-23e5-4087-9906-e6bf87c743f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2285754-a77a-4508-9919-cd6acef07056]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:57 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Volume volume-69a089b6-1ab6-4abe-9369-3acddd166052 (69a089b6-1ab6-4abe-9369-3acddd166052): created successfully
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5535f84c-23e5-4087-9906-e6bf87c743f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Flow 'volume_create_manager' (4447447e-436c-41e1-bf91-839c7a329fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:09:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b69ecafa-7cb3-4619-b86d-98596ee5eeb6 tempest-TestStampPattern-361338379 None] Created volume successfully.
Nov 03 08:09:57 devstack sudo[99109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67
Nov 03 08:09:57 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:57 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" returned: 0 in 0.458s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:57 devstack sudo[99114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c 1G
Nov 03 08:09:57 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:58 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c 1G" returned: 0 in 0.389s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:58 devstack sudo[99119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c
Nov 03 08:09:58 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:58 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c" returned: 0 in 0.293s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:58 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c is being set with open permissions: ugo+rw
Nov 03 08:09:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:58 devstack sudo[99124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c
Nov 03 08:09:58 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:58 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c" returned: 0 in 0.248s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:58 devstack sudo[99127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.info
Nov 03 08:09:58 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:58 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.info" returned: 0 in 0.253s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:58 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.info is being set with open permissions: ugo+rw
Nov 03 08:09:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:58 devstack sudo[99130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.info
Nov 03 08:09:58 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:59 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.info" returned: 0 in 0.243s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.833s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:09:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1679633803',display_name='tempest-VolumesGetTest-Volume-1615268937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd89a9c-b393-4607-af1b-913f5448f06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:46Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Creating volume 7bd89a9c-b393-4607-af1b-913f5448f06b {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:59 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:59 devstack sudo[99133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b 1073741824
Nov 03 08:09:59 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:59 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5108dba4-e905-42aa-8368-a7dee686a50d tempest-SnapshotMetadataTestJSON-105688393 None] Create snapshot completed successfully
Nov 03 08:09:59 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b 1073741824" returned: 0 in 0.415s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:09:59 devstack sudo[99138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b
Nov 03 08:09:59 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:09:59 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b" returned: 0 in 0.283s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.886s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d6d742c8-ac2b-4df7-9642-270429f1879d,created_at=2026-11-03T07:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1580273832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d6d742c8-ac2b-4df7-9642-270429f1879d,host='devstack@QuobyteHD#QuobyteHD',id=2898785c-fec4-4d7d-ab83-e1ff110b8ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aea505933574e618498e86a848409a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:09:47Z,use_quota=True,user_id='dc133919df7247a79a5b05417c3ba712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b884e68-4d02-432e-825c-02fd2dfab449),volume_type_id=9b884e68-4d02-432e-825c-02fd2dfab449)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Creating volume 2898785c-fec4-4d7d-ab83-e1ff110b8ea9 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:09:59 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:09:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce82927e-34a4-416b-9918-dc9daefa01c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd89a9c-b393-4607-af1b-913f5448f06b', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:00 devstack sudo[99141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9 1073741824
Nov 03 08:10:00 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42e95b2-1935-4e08-b96e-107356852337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:00 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Volume volume-7bd89a9c-b393-4607-af1b-913f5448f06b (7bd89a9c-b393-4607-af1b-913f5448f06b): created successfully
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42e95b2-1935-4e08-b96e-107356852337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (d707b661-97fa-4570-9d79-f6ed0d708095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:00 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-44043e0c-35ef-4663-8962-857d4d2e8440 tempest-VolumesGetTest-696480383 None] Created volume successfully.
Nov 03 08:10:00 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9 1073741824" returned: 0 in 0.521s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:00 devstack sudo[99147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9
Nov 03 08:10:00 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Acquiring lock "cinder-cb356373-861b-4005-8d41-1b832bbb6b3c-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Lock "cinder-cb356373-861b-4005-8d41-1b832bbb6b3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Acquiring lock "cinder-quobyte-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Lock "cinder-quobyte-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Acquiring lock "cinder-quobyte-cb356373-861b-4005-8d41-1b832bbb6b3c" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Lock "cinder-quobyte-cb356373-861b-4005-8d41-1b832bbb6b3c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Deleting offline snapshot cb356373-861b-4005-8d41-1b832bbb6b3c of volume d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:10:00 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] snapshot_file for this snap is: volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9" returned: 0 in 0.364s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9084a613-d17c-4bfb-9cf9-33e85f05614e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbb646e-dac7-40d9-9088-eb556274832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c581213e-7186-45cf-9f93-48c1c0ea3068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:00 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Volume volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9 (2898785c-fec4-4d7d-ab83-e1ff110b8ea9): created successfully
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c581213e-7186-45cf-9f93-48c1c0ea3068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Flow 'volume_create_manager' (f9fff4e7-8943-4475-bd85-40c2edb92379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2adb1f1f-f9f1-47c5-aaa7-7a70a695014a tempest-GroupsTest-984456582 None] Created volume successfully.
Nov 03 08:10:01 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c
Nov 03 08:10:01 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-7bd89a9c-b393-4607-af1b-913f5448f06b-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Lock "cinder-7bd89a9c-b393-4607-af1b-913f5448f06b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-quobyte-7bd89a9c-b393-4607-af1b-913f5448f06b" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-7bd89a9c-b393-4607-af1b-913f5448f06b" acquired by "delete_volume" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57afdeb-a8d2-496a-94bc-5fcdb8ebbf6e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:01 devstack sudo[99152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b
Nov 03 08:10:01 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:01 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c" returned: 0 in 0.483s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06db8f5-936d-488e-8636-c11513edfc04]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:01 devstack sudo[99157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67
Nov 03 08:10:01 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:01 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b" returned: 0 in 0.381s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:01 devstack sudo[99162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b
Nov 03 08:10:01 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:01 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" returned: 0 in 0.403s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:01 devstack sudo[99168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c
Nov 03 08:10:01 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:01 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7bd89a9c-b393-4607-af1b-913f5448f06b" returned: 0 in 0.278s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-7bd89a9c-b393-4607-af1b-913f5448f06b" released by "delete_volume" :: held 0.707s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Created reservations ['2e8a7702-bcb7-466b-8ce4-b16951a4c0a7', 'f178cd98-7532-4764-b13f-39fad8e7868d', 'b9c1ce19-f2c2-417d-b3ab-b587a22aee25', '56e250dd-6bad-4de5-9505-ba3c268d0fd3'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:02 devstack sudo[99171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:02 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:02 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c" returned: 0 in 0.468s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:02 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c
Nov 03 08:10:02 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:02 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.331s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Deleted volume successfully.
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eda48bd5-4ed0-4216-af04-796ff3624e83 tempest-VolumesGetTest-696480383 None] Lock "cinder-7bd89a9c-b393-4607-af1b-913f5448f06b-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-645d0b5b-a47d-4b04-b985-ff2a2749105f-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Lock "cinder-645d0b5b-a47d-4b04-b985-ff2a2749105f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-quobyte-645d0b5b-a47d-4b04-b985-ff2a2749105f" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-645d0b5b-a47d-4b04-b985-ff2a2749105f" acquired by "delete_volume" :: waited 0.036s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7636039a-03bc-49c4-a685-8b31b2b30a17]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:02 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67.cb356373-861b-4005-8d41-1b832bbb6b3c" returned: 0 in 0.400s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Lock "cinder-quobyte-cb356373-861b-4005-8d41-1b832bbb6b3c" released by "_delete_snapshot" :: held 1.941s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Lock "cinder-quobyte-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" released by "delete_snapshot" :: held 1.990s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:02 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f
Nov 03 08:10:02 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:02 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Created reservations ['886df439-4cf4-414c-9c8f-6cc8df8e553a', 'd98fedce-993d-4af5-9e74-b9eddcfbd5c7', '12acbddf-b4cf-42e6-82e3-cb9e67fb576f', '8fb540fa-de4e-4441-b6eb-9176791fe09d'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:03 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Delete snapshot completed successfully.
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fba1aa7-a007-4522-b5ae-c3f4749bd4fb tempest-SnapshotMetadataTestJSON-105688393 None] Lock "cinder-cb356373-861b-4005-8d41-1b832bbb6b3c-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:03 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f" returned: 0 in 0.515s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:03 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:03 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Acquiring lock "cinder-quobyte-2898785c-fec4-4d7d-ab83-e1ff110b8ea9" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Lock "cinder-quobyte-2898785c-fec4-4d7d-ab83-e1ff110b8ea9" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:03 devstack sudo[99185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f
Nov 03 08:10:03 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddfec0f-ec64-4fed-944b-653df4ed0a7e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:03 devstack sudo[99188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9
Nov 03 08:10:03 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:03 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.349s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:03 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-645d0b5b-a47d-4b04-b985-ff2a2749105f" returned: 0 in 0.383s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-645d0b5b-a47d-4b04-b985-ff2a2749105f" released by "delete_volume" :: held 0.964s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Created reservations ['799f240e-2945-45e2-b831-06db9ea0b258', 'ece1552a-cbb2-45d3-804c-47f027decf23', '7dd253f5-2348-47de-8780-721dab37b4be', '642912ed-141e-48fd-8b43-5836be345ac1'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:03 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9" returned: 0 in 0.459s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:03 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:03 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:03 devstack sudo[99205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9
Nov 03 08:10:03 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:04 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:04 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2898785c-fec4-4d7d-ab83-e1ff110b8ea9" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.306s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Lock "cinder-quobyte-2898785c-fec4-4d7d-ab83-e1ff110b8ea9" released by "delete_volume" :: held 0.823s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:04 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Deleted volume successfully.
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Acquiring lock "cinder-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-df83f344-116d-4b9b-b2b4-619402f6188f tempest-VolumesGetTest-696480383 None] Lock "cinder-645d0b5b-a47d-4b04-b985-ff2a2749105f-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Lock "cinder-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Created reservations ['db38aa83-0bad-44a0-b8a7-4a9968bab9d2'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Acquiring lock "cinder-quobyte-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Lock "cinder-quobyte-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:04 devstack cinder-volume[86851]: WARNING cinder.quota [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-130798429 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-130798429, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:10:04 devstack cinder-volume[86851]: WARNING cinder.quota [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-130798429 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-130798429, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d715bce-4692-4887-8a68-1ea97bb853f6]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Created reservations ['a281e59c-51a8-423b-8306-226e5bbfb85d', '774433a0-8fe6-49ae-9166-a4be984dcfb0', '55c576d6-7b5b-4d06-a600-a5f6cac484b5', '79e26561-abe1-432d-a4f2-d968523bfc7e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:04 devstack sudo[99210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67
Nov 03 08:10:04 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:04 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:04 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-10fbb1cd-a21c-4288-a63a-9b8b924202e8 tempest-GroupsTest-984456582 None] Created reservations ['38a85b28-638e-465a-b765-dd793bc75c4f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-10fbb1cd-a21c-4288-a63a-9b8b924202e8 tempest-GroupsTest-984456582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-10fbb1cd-a21c-4288-a63a-9b8b924202e8 tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-10fbb1cd-a21c-4288-a63a-9b8b924202e8 tempest-GroupsTest-984456582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-10fbb1cd-a21c-4288-a63a-9b8b924202e8 tempest-GroupsTest-984456582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-10fbb1cd-a21c-4288-a63a-9b8b924202e8 tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-10fbb1cd-a21c-4288-a63a-9b8b924202e8 tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:04 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:04 devstack sudo[99217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:04 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" returned: 0 in 0.409s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:04 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.302s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:04 devstack sudo[99220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67
Nov 03 08:10:04 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:04 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-742fae5d-0e2d-4ee3-9e7a-e619ae0baa30 tempest-GroupsTest-984456582 None] Delete group completed successfully.
Nov 03 08:10:04 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-10fbb1cd-a21c-4288-a63a-9b8b924202e8 tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.268s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-10fbb1cd-a21c-4288-a63a-9b8b924202e8 tempest-GroupsTest-984456582 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:04 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-10fbb1cd-a21c-4288-a63a-9b8b924202e8 tempest-GroupsTest-984456582 None] Delete group completed successfully.
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-93787f02-fbc6-4a45-8ed5-2bd114a7ea05-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:04 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Lock "cinder-93787f02-fbc6-4a45-8ed5-2bd114a7ea05-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" returned: 0 in 0.293s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Lock "cinder-quobyte-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67" released by "delete_volume" :: held 0.784s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-quobyte-93787f02-fbc6-4a45-8ed5-2bd114a7ea05" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-93787f02-fbc6-4a45-8ed5-2bd114a7ea05" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16bb8a4-382d-464a-bb18-60ae7e06fbc5]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Created reservations ['8621b663-1814-4e0e-b1d1-5eefdf627cdf', '1eeb9ba5-f9bf-4eee-9bc7-e819d4ca6f97', '4b91233c-79a8-49c9-8b28-9dc69fe7adef', '27076b28-a130-4739-8fbd-54f0073ee36e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:05 devstack sudo[99224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05
Nov 03 08:10:05 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:05 devstack sudo[99225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:05 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:05 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.262s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:05 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Deleted volume successfully.
Nov 03 08:10:05 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-afd01791-949d-4b6b-96c5-0a7701f646d9 tempest-SnapshotMetadataTestJSON-105688393 None] Lock "cinder-d52ed0fc-359b-46fc-a4f4-e2dd1e675f67-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05" returned: 0 in 0.403s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:05 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05
Nov 03 08:10:05 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:05 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-93787f02-fbc6-4a45-8ed5-2bd114a7ea05" returned: 0 in 0.259s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-93787f02-fbc6-4a45-8ed5-2bd114a7ea05" released by "delete_volume" :: held 0.739s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Created reservations ['8fb512dd-6fb4-4d38-af83-737f3bceeec7', 'ba62a457-aa2c-401c-95b9-9e038d36546a', '00701361-65bf-4a32-86d9-4f0b805d7245', '177dd50b-9ac2-409e-871c-4a9f547c1449'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:05 devstack sudo[99235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:05 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:06 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.346s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c0af3e58-2449-4bdb-b761-0fefa7f65ddf tempest-GroupsTest-984456582 None] Group tempest-GroupsTest-Group-508604081: creating
Nov 03 08:10:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Deleted volume successfully.
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3cf3ebdf-cce9-4d98-b60d-eb1ed024b4d2 tempest-VolumesGetTest-696480383 None] Lock "cinder-93787f02-fbc6-4a45-8ed5-2bd114a7ea05-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c0af3e58-2449-4bdb-b761-0fefa7f65ddf tempest-GroupsTest-984456582 None] Group tempest-GroupsTest-Group-508604081: created successfully
Nov 03 08:10:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c0af3e58-2449-4bdb-b761-0fefa7f65ddf tempest-GroupsTest-984456582 None] Create group completed successfully.
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (5f16151f-eb11-476d-97af-afdb9caa1175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace06297-fbb9-4bf6-a17a-5b6e9f6629c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace06297-fbb9-4bf6-a17a-5b6e9f6629c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1577095736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6da6c3-ba90-4fc3-954f-9826b252f08d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:07Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5aed80-34bc-4842-b644-79104ef20eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5aed80-34bc-4842-b644-79104ef20eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d14a711-af72-41a9-b2dc-70b4de7cdb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:06 devstack cinder-volume[86851]: DEBUG cinder.image.glance [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Creating Keystone auth plugin from conf {{(pid=86851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 08:10:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d14a711-af72-41a9-b2dc-70b4de7cdb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e6da6c3-ba90-4fc3-954f-9826b252f08d', 'volume_name': 'volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d46653d3b90>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b28da48-38e9-4a38-9b74-c49d49410e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b28da48-38e9-4a38-9b74-c49d49410e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1784a798-a4aa-479d-8a23-9c9880e55e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:07 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Volume 5e6da6c3-ba90-4fc3-954f-9826b252f08d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d46653d3b90>}
Nov 03 08:10:07 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Trying to clone 5e6da6c3-ba90-4fc3-954f-9826b252f08d from image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]). {{(pid=86851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 08:10:08 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b14917-c7c0-441e-9468-83a71d2804e9]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Flow 'volume_create_manager' (72b3f3aa-ff96-4852-99f3-f303a0da00ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef4e299-b2cd-4676-9dbb-8f204de484e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef4e299-b2cd-4676-9dbb-8f204de484e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1216523549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9474c2aa-5c48-4caa-a338-d178091e4a6f,host='devstack@QuobyteHD#QuobyteHD',id=751ff7d5-7dd8-4db9-92a5-1e566d982fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aea505933574e618498e86a848409a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:08Z,use_quota=True,user_id='dc133919df7247a79a5b05417c3ba712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5ec3c6d-571a-4afc-a09d-585248cfd936),volume_type_id=c5ec3c6d-571a-4afc-a09d-585248cfd936)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d5a9c5-3c18-41db-8408-c0364da4f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d5a9c5-3c18-41db-8408-c0364da4f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4a2efe-e2a1-460a-91b6-6778e986bce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4a2efe-e2a1-460a-91b6-6778e986bce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751ff7d5-7dd8-4db9-92a5-1e566d982fa8', 'volume_name': 'volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba6f9af-747e-49dd-9790-09538e373833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba6f9af-747e-49dd-9790-09538e373833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:08 devstack sudo[99239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD
Nov 03 08:10:08 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4facbbbd-c8d1-4daa-af40-274d3920e058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:08 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Volume 751ff7d5-7dd8-4db9-92a5-1e566d982fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8', 'volume_size': 1}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9474c2aa-5c48-4caa-a338-d178091e4a6f,created_at=2026-11-03T07:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1216523549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9474c2aa-5c48-4caa-a338-d178091e4a6f,host='devstack@QuobyteHD#QuobyteHD',id=751ff7d5-7dd8-4db9-92a5-1e566d982fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aea505933574e618498e86a848409a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:08Z,use_quota=True,user_id='dc133919df7247a79a5b05417c3ba712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5ec3c6d-571a-4afc-a09d-585248cfd936),volume_type_id=c5ec3c6d-571a-4afc-a09d-585248cfd936)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Creating volume 751ff7d5-7dd8-4db9-92a5-1e566d982fa8 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:10:08 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:08 devstack sudo[99241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8 1073741824
Nov 03 08:10:08 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:08 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Temporary image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 is fetched for user 929e365ed25d4146a0836ab7d242ea19. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4567ee5-af6c-4910-9fec-fb935553d563]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:08 devstack sudo[99249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD
Nov 03 08:10:08 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:08 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8 1073741824" returned: 0 in 0.505s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:08 devstack sudo[99251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8
Nov 03 08:10:08 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:08 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:09 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8" returned: 0 in 0.313s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.156s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1577095736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6da6c3-ba90-4fc3-954f-9826b252f08d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:07Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Creating volume 5e6da6c3-ba90-4fc3-954f-9826b252f08d {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:10:09 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:09 devstack sudo[99257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d 1073741824
Nov 03 08:10:09 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4facbbbd-c8d1-4daa-af40-274d3920e058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03d42a0-0f15-4830-bcac-5424ed16a6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:09 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Volume volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8 (751ff7d5-7dd8-4db9-92a5-1e566d982fa8): created successfully
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03d42a0-0f15-4830-bcac-5424ed16a6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Flow 'volume_create_manager' (72b3f3aa-ff96-4852-99f3-f303a0da00ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a94a4148-b9e0-42b8-a88a-60f83e0e8a3a tempest-GroupsTest-984456582 None] Created volume successfully.
Nov 03 08:10:09 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d 1073741824" returned: 0 in 0.584s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:09 devstack sudo[99263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d
Nov 03 08:10:09 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Flow 'volume_create_manager' (b7d811d6-7e21-44d7-9e5a-0314dcf5f110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e80539-4f6d-4775-a0b2-94476d6c3ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e80539-4f6d-4775-a0b2-94476d6c3ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-600842289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9474c2aa-5c48-4caa-a338-d178091e4a6f,host='devstack@QuobyteHD#QuobyteHD',id=bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aea505933574e618498e86a848409a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:10Z,use_quota=True,user_id='dc133919df7247a79a5b05417c3ba712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5ec3c6d-571a-4afc-a09d-585248cfd936),volume_type_id=c5ec3c6d-571a-4afc-a09d-585248cfd936)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7268bc-6947-4559-a72c-e63b08429c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7268bc-6947-4559-a72c-e63b08429c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494a3fef-e5ab-4d6e-8d47-678de2442006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494a3fef-e5ab-4d6e-8d47-678de2442006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3', 'volume_name': 'volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c64b789-3c14-48a4-ac8a-ae60685a938a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c64b789-3c14-48a4-ac8a-ae60685a938a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117bfb1a-bfb4-4c3b-a5a0-bf57e9ccbddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:10 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Volume bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3', 'volume_size': 1}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:10 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d" returned: 0 in 0.397s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9474c2aa-5c48-4caa-a338-d178091e4a6f,created_at=2026-11-03T07:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-600842289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9474c2aa-5c48-4caa-a338-d178091e4a6f,host='devstack@QuobyteHD#QuobyteHD',id=bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aea505933574e618498e86a848409a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:10Z,use_quota=True,user_id='dc133919df7247a79a5b05417c3ba712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5ec3c6d-571a-4afc-a09d-585248cfd936),volume_type_id=c5ec3c6d-571a-4afc-a09d-585248cfd936)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Creating volume bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:10:10 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:10 devstack sudo[99266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3 1073741824
Nov 03 08:10:10 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Attempting download of 8b203cae-6577-47a3-bc8a-1235a08ecbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}])) to volume 5e6da6c3-ba90-4fc3-954f-9826b252f08d. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[75027a2b-7fd2-4e61-b362-423070e1fced]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_4xlx5lpk {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:10 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_4xlx5lpk
Nov 03 08:10:10 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:10 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_4xlx5lpk" returned: 0 in 0.355s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_4xlx5lpk {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:10 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3 1073741824" returned: 0 in 0.464s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:10 devstack sudo[99277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3
Nov 03 08:10:10 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:10 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_4xlx5lpk
Nov 03 08:10:10 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:10 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3" returned: 0 in 0.261s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:10 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_4xlx5lpk" returned: 1 in 0.345s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_4xlx5lpk' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117bfb1a-bfb4-4c3b-a5a0-bf57e9ccbddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13112f3a-125a-493f-9ddf-2a6168082b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc475d94-994a-47b2-880f-ea0163dcc19f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:10 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Volume volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3 (bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3): created successfully
Nov 03 08:10:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13112f3a-125a-493f-9ddf-2a6168082b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Flow 'volume_create_manager' (b7d811d6-7e21-44d7-9e5a-0314dcf5f110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-249e2000-afa2-4eaf-a366-296f25492b30 tempest-GroupsTest-984456582 None] Created volume successfully.
Nov 03 08:10:11 devstack sudo[99283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD
Nov 03 08:10:11 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:11 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:11 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] 8b203cae-6577-47a3-bc8a-1235a08ecbe1 was qcow2, converting to qcow2 {{(pid=86851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 08:10:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:11 devstack sudo[99288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d
Nov 03 08:10:11 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b35597da-8568-4c6d-a058-4f4cd9ea8432 tempest-GroupsTest-984456582 None] Update group completed successfully.
Nov 03 08:10:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c37de1a2-a0f1-424d-9277-c113d2434470 tempest-GroupsTest-984456582 None] Update group completed successfully.
Nov 03 08:10:13 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d" returned: 0 in 2.037s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_0h8z6p75devstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:10:13 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Converted 112.00 MB image at 54.96 MB/s
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:13 devstack sudo[99296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d 1G
Nov 03 08:10:13 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:13 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d 1G" returned: 0 in 0.413s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Downloaded image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}])) to volume 5e6da6c3-ba90-4fc3-954f-9826b252f08d successfully. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Temporary image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 for user 929e365ed25d4146a0836ab7d242ea19 is deleted. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Marking volume 5e6da6c3-ba90-4fc3-954f-9826b252f08d as bootable. {{(pid=86851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Copying metadata from image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 to 5e6da6c3-ba90-4fc3-954f-9826b252f08d. {{(pid=86851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Creating volume glance metadata for volume 5e6da6c3-ba90-4fc3-954f-9826b252f08d backed by image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1784a798-a4aa-479d-8a23-9c9880e55e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d46653d3b90>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5bd0cb-82d6-437b-a6aa-5da591a64585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Volume volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d (5e6da6c3-ba90-4fc3-954f-9826b252f08d): created successfully
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5bd0cb-82d6-437b-a6aa-5da591a64585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (5f16151f-eb11-476d-97af-afdb9caa1175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d44480f8-beaa-4053-bf3d-fea36dc91301 tempest-VolumesGetTest-696480383 None] Created volume successfully.
Nov 03 08:10:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Acquiring lock "cinder-quobyte-751ff7d5-7dd8-4db9-92a5-1e566d982fa8" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Lock "cinder-quobyte-751ff7d5-7dd8-4db9-92a5-1e566d982fa8" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9aa7d2-0d74-45e5-8443-d5b8b437e48c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:14 devstack sudo[99303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8
Nov 03 08:10:14 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:15 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8" returned: 0 in 0.665s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:15 devstack sudo[99308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8
Nov 03 08:10:15 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (cb486612-d24b-48de-9c8c-943eba82eef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5090a717-8a55-4b8f-8437-f69e53096fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5090a717-8a55-4b8f-8437-f69e53096fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-430836499',display_name='tempest-VolumesGetTest-Volume-1945716449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8975b56-5a6c-410c-863c-63291fdd5759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:16Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0bb2f6-2977-4fec-bcf0-8d103a9fa4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0bb2f6-2977-4fec-bcf0-8d103a9fa4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b6b110-d9ad-4867-a135-2e027c37933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b6b110-d9ad-4867-a135-2e027c37933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8975b56-5a6c-410c-863c-63291fdd5759', 'volume_name': 'volume-c8975b56-5a6c-410c-863c-63291fdd5759', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5c36ab-1f3a-4943-beae-7dcb1f18fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5c36ab-1f3a-4943-beae-7dcb1f18fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b7e510-ae5e-47d2-8040-de7220d9f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:15 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Volume c8975b56-5a6c-410c-863c-63291fdd5759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8975b56-5a6c-410c-863c-63291fdd5759', 'volume_size': 1}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-430836499',display_name='tempest-VolumesGetTest-Volume-1945716449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8975b56-5a6c-410c-863c-63291fdd5759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b13c137cef0452cba3c670ae78b8db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:16Z,use_quota=True,user_id='929e365ed25d4146a0836ab7d242ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Creating volume c8975b56-5a6c-410c-863c-63291fdd5759 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:15 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:10:15 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-751ff7d5-7dd8-4db9-92a5-1e566d982fa8" returned: 0 in 0.574s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Lock "cinder-quobyte-751ff7d5-7dd8-4db9-92a5-1e566d982fa8" released by "delete_volume" :: held 1.352s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Acquiring lock "cinder-quobyte-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:15 devstack sudo[99313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759 1073741824
Nov 03 08:10:15 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Lock "cinder-quobyte-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0482000-6c4a-4675-89b9-de00a907e8c2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:16 devstack sudo[99315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3
Nov 03 08:10:16 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:16 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759 1073741824" returned: 0 in 0.605s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:16 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3" returned: 0 in 0.503s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:16 devstack sudo[99326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3
Nov 03 08:10:16 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:16 devstack sudo[99329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759
Nov 03 08:10:16 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:16 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3" returned: 0 in 0.346s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Lock "cinder-quobyte-bbe54804-e4ee-46a4-a0a7-f8a5dbf0a4c3" released by "delete_volume" :: held 0.942s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:16 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759" returned: 0 in 0.345s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b7e510-ae5e-47d2-8040-de7220d9f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8975b56-5a6c-410c-863c-63291fdd5759', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966bd3f8-15f0-45d8-8e40-8d46866b8cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:17 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Volume volume-c8975b56-5a6c-410c-863c-63291fdd5759 (c8975b56-5a6c-410c-863c-63291fdd5759): created successfully
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966bd3f8-15f0-45d8-8e40-8d46866b8cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Flow 'volume_create_manager' (cb486612-d24b-48de-9c8c-943eba82eef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9d809b45-f3cd-48d0-98cd-0e8e453883fc tempest-VolumesGetTest-696480383 None] Created volume successfully.
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Created reservations ['5d4822e6-440c-4315-9e2d-215c9b5b0c31'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:17 devstack cinder-volume[86851]: WARNING cinder.quota [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2067644620 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2067644620, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:10:17 devstack cinder-volume[86851]: WARNING cinder.quota [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2067644620 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2067644620, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Created reservations ['81d25e0c-7652-4d9a-a841-ba254e174a27', 'c97c02db-ffc2-498f-a3a7-e55c65b631b2', 'aaa133a4-535c-41d1-82d5-701f73fdbe03', 'cd76ce0a-beb0-4042-bcae-734e7c322edb'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Created reservations ['959f3959-894c-4c2d-9804-20788d67edc9', 'e76932eb-d7aa-42ba-81ce-d40dc11155d3', 'cc74c0ca-ce6b-45dd-b6c0-b43d93c7fc97', '28a73d10-98c0-479c-965f-f5dfe553d7ba'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:17 devstack sudo[99336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:17 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:17 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.287s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-97a09dcd-2947-4766-952c-4facb24f3743 tempest-GroupsTest-984456582 None] Delete group completed successfully.
Nov 03 08:10:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-c8975b56-5a6c-410c-863c-63291fdd5759-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Lock "cinder-c8975b56-5a6c-410c-863c-63291fdd5759-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-quobyte-c8975b56-5a6c-410c-863c-63291fdd5759" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-c8975b56-5a6c-410c-863c-63291fdd5759" acquired by "delete_volume" :: waited 0.030s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2578605-3160-43b7-9c7d-69a78bc9fa93]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:18 devstack sudo[99351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759
Nov 03 08:10:18 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-6fd84c59-5865-452f-96ce-d6598f7b0006 req-66a5cb90-6268-4c51-9876-593ae7b3decf tempest-TestStampPattern-361338379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-6fd84c59-5865-452f-96ce-d6598f7b0006 req-66a5cb90-6268-4c51-9876-593ae7b3decf tempest-TestStampPattern-361338379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-6fd84c59-5865-452f-96ce-d6598f7b0006 req-66a5cb90-6268-4c51-9876-593ae7b3decf tempest-TestStampPattern-361338379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-6fd84c59-5865-452f-96ce-d6598f7b0006 req-66a5cb90-6268-4c51-9876-593ae7b3decf tempest-TestStampPattern-361338379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-69a089b6-1ab6-4abe-9369-3acddd166052', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3b31ac7-24a2-411e-a728-264558565ca2', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:10:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-6fd84c59-5865-452f-96ce-d6598f7b0006 req-66a5cb90-6268-4c51-9876-593ae7b3decf tempest-TestStampPattern-361338379 None] attachment_update completed successfully.
Nov 03 08:10:18 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759" returned: 0 in 0.451s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:18 devstack sudo[99364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759
Nov 03 08:10:18 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:19 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c8975b56-5a6c-410c-863c-63291fdd5759" returned: 0 in 0.421s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-c8975b56-5a6c-410c-863c-63291fdd5759" released by "delete_volume" :: held 0.952s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Created reservations ['c12a242d-a89e-474d-9429-8d892494f964', '823c39ab-1300-4455-bb95-abc70557e99f', '7947669c-e6ba-4bd6-8c93-c88557b97bdc', '89f0d3f5-5b10-450d-a3f9-3fd4e1da048a'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:19 devstack sudo[99781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:19 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:19 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.358s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:19 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Deleted volume successfully.
Nov 03 08:10:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2305a768-57a0-441c-b7ba-45f5cabedce2 tempest-VolumesGetTest-696480383 None] Lock "cinder-c8975b56-5a6c-410c-863c-63291fdd5759-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-5e6da6c3-ba90-4fc3-954f-9826b252f08d-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Lock "cinder-5e6da6c3-ba90-4fc3-954f-9826b252f08d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Acquiring lock "cinder-quobyte-5e6da6c3-ba90-4fc3-954f-9826b252f08d" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-5e6da6c3-ba90-4fc3-954f-9826b252f08d" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:20 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ab1cd8-fa18-43d1-9108-96d2935fb39b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:20 devstack sudo[99794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d
Nov 03 08:10:20 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:21 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d" returned: 0 in 0.554s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:21 devstack sudo[99807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d
Nov 03 08:10:21 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:21 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5e6da6c3-ba90-4fc3-954f-9826b252f08d" returned: 0 in 0.304s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Lock "cinder-quobyte-5e6da6c3-ba90-4fc3-954f-9826b252f08d" released by "delete_volume" :: held 0.934s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Created reservations ['8c663f45-0e19-45b7-ae4f-da688a8462f9', '50d237d3-1208-44ae-825d-24c0a402d3d3', '482168f4-bf9c-425a-99de-c18ab82ee688', '16c935a0-50d1-4a56-b3e8-5c67c9c95520'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:21 devstack sudo[99810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:21 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:22 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.443s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:22 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Deleted volume successfully.
Nov 03 08:10:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bdd01a26-f6d7-4997-ae25-e9989a37471a tempest-VolumesGetTest-696480383 None] Lock "cinder-5e6da6c3-ba90-4fc3-954f-9826b252f08d-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-6d8b4d1f-2273-4eee-8123-45aa939f3da3 req-c165631a-2872-4598-b9f5-404eee5f9a76 tempest-TestStampPattern-361338379 None] Terminate volume connection completed successfully.
Nov 03 08:10:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-6d8b4d1f-2273-4eee-8123-45aa939f3da3 req-c165631a-2872-4598-b9f5-404eee5f9a76 tempest-TestStampPattern-361338379 None] Deleting attachment d3b31ac7-24a2-411e-a728-264558565ca2. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:10:27 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-003aa098-a8b3-4539-a91e-9a06b7c47a2f tempest-GroupsV314Test-793160574 None] Group tempest-GroupsV314Test-Group-1038912946: creating
Nov 03 08:10:27 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-003aa098-a8b3-4539-a91e-9a06b7c47a2f tempest-GroupsV314Test-793160574 None] Group tempest-GroupsV314Test-Group-1038912946: created successfully
Nov 03 08:10:27 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-003aa098-a8b3-4539-a91e-9a06b7c47a2f tempest-GroupsV314Test-793160574 None] Create group completed successfully.
Nov 03 08:10:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Acquiring lock "cinder-69a089b6-1ab6-4abe-9369-3acddd166052-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Lock "cinder-69a089b6-1ab6-4abe-9369-3acddd166052-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Acquiring lock "cinder-quobyte-69a089b6-1ab6-4abe-9369-3acddd166052" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-69a089b6-1ab6-4abe-9369-3acddd166052" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:28 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b510bff-35c5-4da5-9455-f451b258ff4d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:28 devstack sudo[99885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052
Nov 03 08:10:28 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:28 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052" returned: 0 in 0.420s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:28 devstack sudo[99891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052
Nov 03 08:10:28 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:28 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-69a089b6-1ab6-4abe-9369-3acddd166052" returned: 0 in 0.398s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-69a089b6-1ab6-4abe-9369-3acddd166052" released by "delete_volume" :: held 0.877s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Created reservations ['e8005dd4-3b19-4b29-8500-be75166d20f9', 'f7920c0d-f24d-42bf-8ccf-e0ac22ae4b21', '269d5892-a6aa-41af-a104-4b97d27d8f0c', '21c7077e-4bd8-45b1-a450-200b8529757f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:29 devstack sudo[99894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:29 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Flow 'volume_create_manager' (bc5476d2-2023-4675-bed5-455049987695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd375fa0-4a09-49e2-8f7d-4c4f631d603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:29 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd375fa0-4a09-49e2-8f7d-4c4f631d603d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1109122744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1f6074-3149-4aac-9fd7-036c00540f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238ab1d0071c49e7a09d544e31dac999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:29Z,use_quota=True,user_id='e232cee2abd64841a36a1df93149f692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebb03c5-0980-4796-84ae-9e2166ed0ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebb03c5-0980-4796-84ae-9e2166ed0ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f9149b-d669-45c4-996e-ff90d6be37df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f9149b-d669-45c4-996e-ff90d6be37df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f1f6074-3149-4aac-9fd7-036c00540f85', 'volume_name': 'volume-1f1f6074-3149-4aac-9fd7-036c00540f85', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798b1069-3fc4-4c28-abd5-fb7c4ae05f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798b1069-3fc4-4c28-abd5-fb7c4ae05f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defac960-5d88-4133-9675-ff73ea176539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:29 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Volume 1f1f6074-3149-4aac-9fd7-036c00540f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f1f6074-3149-4aac-9fd7-036c00540f85', 'volume_size': 1}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1109122744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1f6074-3149-4aac-9fd7-036c00540f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238ab1d0071c49e7a09d544e31dac999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:29Z,use_quota=True,user_id='e232cee2abd64841a36a1df93149f692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Creating volume 1f1f6074-3149-4aac-9fd7-036c00540f85 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:10:29 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.533s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:29 devstack sudo[99898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85 1073741824
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:10:29 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Flow 'volume_create_manager' (4dcf246d-71b3-422d-a2d1-3c37aee4d5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6e357c-3e43-41c2-a207-61fbce705046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:29 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Deleted volume successfully.
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6e357c-3e43-41c2-a207-61fbce705046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-419950163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36bea039-881c-4d6f-b3b1-955fe91a7c92,host='devstack@QuobyteHD#QuobyteHD',id=4699bfbf-b765-4b38-b514-14c9c33e2383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476dde06aecc4489b508d385ae0fdc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:29Z,use_quota=True,user_id='518178931f4a43a9871a3a313cc0e7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f33eebd-47c4-4be5-96b4-eec4d5553163),volume_type_id=5f33eebd-47c4-4be5-96b4-eec4d5553163)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bba13a1-2a14-4ab9-8fc5-1d7d6c85790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bba13a1-2a14-4ab9-8fc5-1d7d6c85790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd94964-2b8f-4248-90fd-09ca370fb21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd94964-2b8f-4248-90fd-09ca370fb21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4699bfbf-b765-4b38-b514-14c9c33e2383', 'volume_name': 'volume-4699bfbf-b765-4b38-b514-14c9c33e2383', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53e5681-3106-4f22-a607-b32120dfe3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53e5681-3106-4f22-a607-b32120dfe3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace36d6d-003d-447d-9c50-1549976f5419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:29 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Volume 4699bfbf-b765-4b38-b514-14c9c33e2383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4699bfbf-b765-4b38-b514-14c9c33e2383', 'volume_size': 1}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Acquiring lock "cinder-db3a4119-45f6-4589-9d48-1dd825d7ad56-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-47e36fba-1c46-440b-927d-b33f05051ec6 tempest-TestStampPattern-361338379 None] Lock "cinder-69a089b6-1ab6-4abe-9369-3acddd166052-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Lock "cinder-db3a4119-45f6-4589-9d48-1dd825d7ad56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Acquiring lock "cinder-quobyte-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Acquiring lock "cinder-quobyte-db3a4119-45f6-4589-9d48-1dd825d7ad56" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-db3a4119-45f6-4589-9d48-1dd825d7ad56" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Deleting offline snapshot db3a4119-45f6-4589-9d48-1dd825d7ad56 of volume c4c867dc-9a81-4bcd-b133-ddb566f2c45d {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] snapshot_file for this snap is: volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70beeca-f37b-43aa-baab-84897f14d656]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:30 devstack sudo[99903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56
Nov 03 08:10:30 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:30 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85 1073741824" returned: 0 in 0.622s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:30 devstack sudo[99905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85
Nov 03 08:10:30 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:30 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56" returned: 0 in 0.472s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfac79e9-5425-477b-8dee-ee20c9befb10]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:30 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85" returned: 0 in 0.299s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=36bea039-881c-4d6f-b3b1-955fe91a7c92,created_at=2026-11-03T07:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-419950163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36bea039-881c-4d6f-b3b1-955fe91a7c92,host='devstack@QuobyteHD#QuobyteHD',id=4699bfbf-b765-4b38-b514-14c9c33e2383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476dde06aecc4489b508d385ae0fdc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:29Z,use_quota=True,user_id='518178931f4a43a9871a3a313cc0e7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f33eebd-47c4-4be5-96b4-eec4d5553163),volume_type_id=5f33eebd-47c4-4be5-96b4-eec4d5553163)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Creating volume 4699bfbf-b765-4b38-b514-14c9c33e2383 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:10:30 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:30 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d
Nov 03 08:10:30 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defac960-5d88-4133-9675-ff73ea176539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f1f6074-3149-4aac-9fd7-036c00540f85', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2dd6dc-ce15-4aa3-88f9-86a1a08d785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:30 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 1073741824
Nov 03 08:10:30 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:30 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Volume volume-1f1f6074-3149-4aac-9fd7-036c00540f85 (1f1f6074-3149-4aac-9fd7-036c00540f85): created successfully
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2dd6dc-ce15-4aa3-88f9-86a1a08d785d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Flow 'volume_create_manager' (bc5476d2-2023-4675-bed5-455049987695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:30 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-34cbb4f7-9494-4842-9b4d-6d56198ca86d tempest-VolumesNegativeTest-1715954613 None] Created volume successfully.
Nov 03 08:10:31 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" returned: 0 in 0.590s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:31 devstack sudo[99926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56
Nov 03 08:10:31 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:31 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 1073741824" returned: 0 in 0.621s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:31 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383
Nov 03 08:10:31 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:31 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383" returned: 0 in 0.305s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:31 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56" returned: 0 in 0.496s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace36d6d-003d-447d-9c50-1549976f5419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4699bfbf-b765-4b38-b514-14c9c33e2383', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:31 devstack sudo[99935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56
Nov 03 08:10:31 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc9bee3-9fb4-415e-b211-7749a5a55d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:31 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Volume volume-4699bfbf-b765-4b38-b514-14c9c33e2383 (4699bfbf-b765-4b38-b514-14c9c33e2383): created successfully
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc9bee3-9fb4-415e-b211-7749a5a55d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Flow 'volume_create_manager' (4dcf246d-71b3-422d-a2d1-3c37aee4d5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:31 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0f8183ea-4011-4ad5-a422-0beacca9dccc tempest-GroupsV314Test-793160574 None] Created volume successfully.
Nov 03 08:10:32 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d.db3a4119-45f6-4589-9d48-1dd825d7ad56" returned: 0 in 0.370s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-db3a4119-45f6-4589-9d48-1dd825d7ad56" released by "_delete_snapshot" :: held 2.119s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" released by "delete_snapshot" :: held 2.161s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:32 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Created reservations ['40e17ca0-f50e-4bd9-8822-7a05250134b3', '3d829374-eceb-4636-97fa-cedcd20c5a08', 'da61b642-3c32-4b66-a096-d5ae3c6aecfe', 'deb6def0-e102-4206-b3c3-1b65f7693e12'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:32 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Delete snapshot completed successfully.
Nov 03 08:10:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca5c4109-ec3b-453a-a7a8-33e264107d9a tempest-TestStampPattern-361338379 None] Lock "cinder-db3a4119-45f6-4589-9d48-1dd825d7ad56-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:33 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Cloning volume 4699bfbf-b765-4b38-b514-14c9c33e2383 to volume 10403550-2063-4d76-966b-eee9c54e84c8
Nov 03 08:10:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Creating offline snapshot 434a8fdc-2141-4370-8903-5c0112a2153f of volume 4699bfbf-b765-4b38-b514-14c9c33e2383 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:10:34 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[193edc73-9aaf-4320-97a0-b28451216345]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:34 devstack sudo[99982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383
Nov 03 08:10:34 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:34 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383" returned: 0 in 0.661s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:34 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f 1G
Nov 03 08:10:34 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:35 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f 1G" returned: 0 in 0.743s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4699bfbf-b765-4b38-b514-14c9c33e2383 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:35 devstack sudo[100027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4699bfbf-b765-4b38-b514-14c9c33e2383 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f
Nov 03 08:10:35 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:35 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4699bfbf-b765-4b38-b514-14c9c33e2383 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f" returned: 0 in 0.410s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:35 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:10:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:35 devstack sudo[100035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f
Nov 03 08:10:35 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:36 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f" returned: 0 in 0.369s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:36 devstack sudo[100038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.info
Nov 03 08:10:36 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:36 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.info" returned: 0 in 0.342s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:36 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:10:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:36 devstack sudo[100041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.info
Nov 03 08:10:36 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:37 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.info" returned: 0 in 0.363s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Acquiring lock "cinder-quobyte-10403550-2063-4d76-966b-eee9c54e84c8" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Lock "cinder-quobyte-10403550-2063-4d76-966b-eee9c54e84c8" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] snapshot: 434a8fdc-2141-4370-8903-5c0112a2153f, volume: 10403550-2063-4d76-966b-eee9c54e84c8,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9d85c6-8450-47ec-a315-669bff6bebb6]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:37 devstack sudo[100044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f
Nov 03 08:10:37 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:37 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f" returned: 0 in 0.546s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4699bfbf-b765-4b38-b514-14c9c33e2383(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[489c949a-6609-4cd8-a23e-321b53673d6d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:38 devstack sudo[100051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383
Nov 03 08:10:38 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:38 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383" returned: 0 in 0.921s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:10:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:10:38 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8 not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:10:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:38 devstack sudo[100056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8
Nov 03 08:10:38 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Acquiring lock "cinder-c4c867dc-9a81-4bcd-b133-ddb566f2c45d-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Lock "cinder-c4c867dc-9a81-4bcd-b133-ddb566f2c45d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Acquiring lock "cinder-quobyte-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" acquired by "delete_volume" :: waited 0.055s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:40 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6615a2fc-e5f6-459f-8db9-6bb3eddef402]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:40 devstack sudo[100069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d
Nov 03 08:10:40 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:41 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" returned: 0 in 0.994s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:41 devstack sudo[100075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d
Nov 03 08:10:41 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:42 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" returned: 0 in 0.975s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Lock "cinder-quobyte-c4c867dc-9a81-4bcd-b133-ddb566f2c45d" released by "delete_volume" :: held 2.214s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:42 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Created reservations ['fe478d62-e4be-4e6d-94c4-9e92dc195bc1', '370443cc-52ea-4db8-9e49-986cbd112062', 'ef3a9d9f-e84f-4d75-aaf6-397f6b19d5a9', '990b430b-9b37-4da9-847b-eeacfb620789'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:42 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:42 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:43 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.739s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:43 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Deleted volume successfully.
Nov 03 08:10:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a1f73133-efb1-4578-9506-b1b8bdab787a tempest-TestStampPattern-361338379 None] Lock "cinder-c4c867dc-9a81-4bcd-b133-ddb566f2c45d-delete_volume" released by "delete_volume" :: held 3.756s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:45 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:10:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Flow 'volume_create_manager' (3a5e8c3c-da0e-4ebd-a177-789a94e44704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d7ca11-abbc-48a7-8e8c-5f68e4df8fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d7ca11-abbc-48a7-8e8c-5f68e4df8fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1218757150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ba2c37-cbda-4dbc-a74b-f46338adeef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c31d8666de54532b3597422ae27e3ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:46Z,use_quota=True,user_id='0925b3da832e4558b88b921fe8d9c826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da510ba8-05c6-4580-9a32-fd985fc0aaa8),volume_type_id=da510ba8-05c6-4580-9a32-fd985fc0aaa8)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7553c5-cbbe-4a88-9392-831fbe42d1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7553c5-cbbe-4a88-9392-831fbe42d1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afb9712-b826-451f-8243-51a5bd434443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afb9712-b826-451f-8243-51a5bd434443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ba2c37-cbda-4dbc-a74b-f46338adeef5', 'volume_name': 'volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37df71d1-8f6a-428b-8cfd-f4394f45ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37df71d1-8f6a-428b-8cfd-f4394f45ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb588a92-e65b-4c09-acfd-b60bb4aec04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:46 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Volume c6ba2c37-cbda-4dbc-a74b-f46338adeef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5', 'volume_size': 1}
Nov 03 08:10:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Flow 'volume_create_manager' (59567b9a-a9a9-4cca-89c6-6a55c653520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f7d20e-9fa7-40e5-bbaf-7d0fbab8e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f7d20e-9fa7-40e5-bbaf-7d0fbab8e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-404665876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e576f2dd-0ea2-4aa3-a866-bdc6175e02ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c31d8666de54532b3597422ae27e3ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:47Z,use_quota=True,user_id='0925b3da832e4558b88b921fe8d9c826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44363979-e40d-4ed9-818f-21793e0bdcbe),volume_type_id=44363979-e40d-4ed9-818f-21793e0bdcbe)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c816d1ba-95b9-49bc-89d6-f8f21a76818a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c816d1ba-95b9-49bc-89d6-f8f21a76818a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf77f76-b0dd-4e9c-8bd3-9df70c393fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf77f76-b0dd-4e9c-8bd3-9df70c393fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e576f2dd-0ea2-4aa3-a866-bdc6175e02ee', 'volume_name': 'volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71cfece-939a-4aa1-99a4-ef2593961794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71cfece-939a-4aa1-99a4-ef2593961794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f39b177-9f1c-43b6-82f6-f38f4a5deb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:47 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Volume e576f2dd-0ea2-4aa3-a866-bdc6175e02ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee', 'volume_size': 1}
Nov 03 08:10:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:49 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:10:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Flow 'volume_create_manager' (f2cb6d22-2110-4bcc-b694-f842cb8b5c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bccc53-38ac-4014-8182-252ce57b689c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bccc53-38ac-4014-8182-252ce57b689c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-9824787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f57ee2-f9d3-451b-9cc0-06850884165c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c31d8666de54532b3597422ae27e3ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:49Z,use_quota=True,user_id='0925b3da832e4558b88b921fe8d9c826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2121f4a1-0866-43d8-9783-c5f776b2b0ba),volume_type_id=2121f4a1-0866-43d8-9783-c5f776b2b0ba)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12bdf1f-fc1f-41a9-a005-044c55bd3788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12bdf1f-fc1f-41a9-a005-044c55bd3788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdc36cc-e727-4862-be49-1518a55d34bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:49 devstack cinder-volume[86851]: DEBUG cinder.image.glance [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Creating Keystone auth plugin from conf {{(pid=86851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdc36cc-e727-4862-be49-1518a55d34bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5f57ee2-f9d3-451b-9cc0-06850884165c', 'volume_name': 'volume-c5f57ee2-f9d3-451b-9cc0-06850884165c', 'volume_size': 1, 'image_id': '428fc5de-21dc-48af-88b5-ae68769717e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/428fc5de-21dc-48af-88b5-ae68769717e9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--291806693', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c31d8666de54532b3597422ae27e3ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '428fc5de-21dc-48af-88b5-ae68769717e9', 'created_at': datetime.datetime(2026, 11, 3, 7, 10, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 10, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/428fc5de-21dc-48af-88b5-ae68769717e9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466faa8320>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7588ce9b-9e6f-472d-ad86-9a30c309bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7588ce9b-9e6f-472d-ad86-9a30c309bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5732dbb-85e4-45a6-8a85-c241ab22c327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:50 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Volume c5f57ee2-f9d3-451b-9cc0-06850884165c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5f57ee2-f9d3-451b-9cc0-06850884165c', 'volume_size': 1, 'image_id': '428fc5de-21dc-48af-88b5-ae68769717e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/428fc5de-21dc-48af-88b5-ae68769717e9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--291806693', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c31d8666de54532b3597422ae27e3ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '428fc5de-21dc-48af-88b5-ae68769717e9', 'created_at': datetime.datetime(2026, 11, 3, 7, 10, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 10, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/428fc5de-21dc-48af-88b5-ae68769717e9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466faa8320>}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Trying to clone c5f57ee2-f9d3-451b-9cc0-06850884165c from image 428fc5de-21dc-48af-88b5-ae68769717e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/428fc5de-21dc-48af-88b5-ae68769717e9', 'metadata': {}}]). {{(pid=86851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 08:10:50 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8" returned: 0 in 11.711s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383, size 1024.00 MB, duration 11.71 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:10:50 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Converted 1024.00 MB image at 87.43 MB/s
Nov 03 08:10:50 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:50 devstack sudo[100172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8
Nov 03 08:10:50 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:50 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8" returned: 0 in 0.331s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Lock "cinder-quobyte-10403550-2063-4d76-966b-eee9c54e84c8" released by "_copy_volume_from_snapshot" :: held 13.668s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Acquiring lock "cinder-quobyte-434a8fdc-2141-4370-8903-5c0112a2153f" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Lock "cinder-quobyte-434a8fdc-2141-4370-8903-5c0112a2153f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Deleting offline snapshot 434a8fdc-2141-4370-8903-5c0112a2153f of volume 4699bfbf-b765-4b38-b514-14c9c33e2383 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] snapshot_file for this snap is: volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[433a2ced-d03f-4dc4-99ab-1c05079db153]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:51 devstack sudo[100177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f
Nov 03 08:10:51 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:51 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f" returned: 0 in 0.506s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4699bfbf-b765-4b38-b514-14c9c33e2383(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:10:51 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1188c49b-ded3-46fe-9592-d2df92dc56ed]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:51 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383
Nov 03 08:10:51 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:52 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383" returned: 0 in 0.755s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:52 devstack sudo[100188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f
Nov 03 08:10:52 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:52 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f" returned: 0 in 0.460s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:52 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f
Nov 03 08:10:52 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:52 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383.434a8fdc-2141-4370-8903-5c0112a2153f" returned: 0 in 0.283s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Lock "cinder-quobyte-434a8fdc-2141-4370-8903-5c0112a2153f" released by "_delete_snapshot" :: held 2.173s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.116s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.885s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1218757150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ba2c37-cbda-4dbc-a74b-f46338adeef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c31d8666de54532b3597422ae27e3ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:46Z,use_quota=True,user_id='0925b3da832e4558b88b921fe8d9c826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da510ba8-05c6-4580-9a32-fd985fc0aaa8),volume_type_id=da510ba8-05c6-4580-9a32-fd985fc0aaa8)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Creating volume c6ba2c37-cbda-4dbc-a74b-f46338adeef5 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:10:53 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:53 devstack sudo[100197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5 1073741824
Nov 03 08:10:53 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:53 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e7d8dae7-43f7-437b-99e7-98ffe1343533 tempest-GroupsV314Test-793160574 None] Create group from source-group-36bea039-881c-4d6f-b3b1-955fe91a7c92 completed successfully.
Nov 03 08:10:53 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5 1073741824" returned: 0 in 0.774s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:53 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5
Nov 03 08:10:53 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Acquiring lock "cinder-quobyte-10403550-2063-4d76-966b-eee9c54e84c8" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Lock "cinder-quobyte-10403550-2063-4d76-966b-eee9c54e84c8" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2685c48f-37b5-4e05-9455-c350409c55c2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:54 devstack sudo[100206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8
Nov 03 08:10:54 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:54 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5" returned: 0 in 0.483s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.522s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-404665876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e576f2dd-0ea2-4aa3-a866-bdc6175e02ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c31d8666de54532b3597422ae27e3ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:47Z,use_quota=True,user_id='0925b3da832e4558b88b921fe8d9c826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44363979-e40d-4ed9-818f-21793e0bdcbe),volume_type_id=44363979-e40d-4ed9-818f-21793e0bdcbe)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Creating volume e576f2dd-0ea2-4aa3-a866-bdc6175e02ee {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:10:54 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb588a92-e65b-4c09-acfd-b60bb4aec04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f346f757-1169-45ba-ba75-53030a6ed9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:54 devstack sudo[100209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee 1073741824
Nov 03 08:10:54 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:54 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Volume volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5 (c6ba2c37-cbda-4dbc-a74b-f46338adeef5): created successfully
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f346f757-1169-45ba-ba75-53030a6ed9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Flow 'volume_create_manager' (3a5e8c3c-da0e-4ebd-a177-789a94e44704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:54 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-78baa0ed-6897-48bd-8795-6d557672c1e5 tempest-TestInstancesWithCinderVolumes-685174399 None] Created volume successfully.
Nov 03 08:10:54 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8" returned: 0 in 0.682s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:54 devstack sudo[100219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8
Nov 03 08:10:54 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:55 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:55 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-10403550-2063-4d76-966b-eee9c54e84c8" returned: 0 in 0.428s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee 1073741824" returned: 0 in 0.902s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Lock "cinder-quobyte-10403550-2063-4d76-966b-eee9c54e84c8" released by "delete_volume" :: held 1.178s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:55 devstack sudo[100224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee
Nov 03 08:10:55 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Created reservations ['fa31d4dc-85e5-4b04-97ac-68a9246da31a'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:55 devstack cinder-volume[86851]: WARNING cinder.quota [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-773214977 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-773214977, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:10:55 devstack cinder-volume[86851]: WARNING cinder.quota [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-773214977 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-773214977, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Created reservations ['75b09657-2d17-4f9f-b187-d440edbcf3a8', '33286901-7392-45b7-b601-ceaf836aaf82', 'b22c8e5d-2c72-4b3a-be36-447a89543428', '547af15f-c3fb-43ca-a08c-821b13d236bd'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD, size 20.69 MB, duration 5.33 sec {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 08:10:55 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Image download 20.69 MB at 3.88 MB/s
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ea2903-96bd-40b5-95e7-f404a9342dfb]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:55 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:55 devstack sudo[100228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee" returned: 0 in 0.411s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:55 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f39b177-9f1c-43b6-82f6-f38f4a5deb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2721571a-056f-4f57-b352-70ab9ca71fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:10:55 devstack sudo[100226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD
Nov 03 08:10:55 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Volume volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee (e576f2dd-0ea2-4aa3-a866-bdc6175e02ee): created successfully
Nov 03 08:10:55 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2721571a-056f-4f57-b352-70ab9ca71fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:10:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Flow 'volume_create_manager' (59567b9a-a9a9-4cca-89c6-6a55c653520b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:10:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-46b0e892-c695-40cb-bcd3-d5c0de065077 tempest-TestInstancesWithCinderVolumes-685174399 None] Created volume successfully.
Nov 03 08:10:56 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.329s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:56 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-964ea988-70b3-4a99-a2a0-0b7016c4e4fd tempest-GroupsV314Test-793160574 None] Delete group completed successfully.
Nov 03 08:10:56 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Temporary image 428fc5de-21dc-48af-88b5-ae68769717e9 is fetched for user 0925b3da832e4558b88b921fe8d9c826. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dc426d-087c-4b51-914c-16989d32dcae]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:56 devstack sudo[100236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD
Nov 03 08:10:56 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:56 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-9824787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f57ee2-f9d3-451b-9cc0-06850884165c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c31d8666de54532b3597422ae27e3ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:10:49Z,use_quota=True,user_id='0925b3da832e4558b88b921fe8d9c826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2121f4a1-0866-43d8-9783-c5f776b2b0ba),volume_type_id=2121f4a1-0866-43d8-9783-c5f776b2b0ba)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Creating volume c5f57ee2-f9d3-451b-9cc0-06850884165c {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:10:56 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:56 devstack sudo[100242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c 1073741824
Nov 03 08:10:56 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=144,cinder:UPDATE=170,cinder:INSERT=48,cinder:DELETE=6 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Acquiring lock "cinder-quobyte-4699bfbf-b765-4b38-b514-14c9c33e2383" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:10:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Lock "cinder-quobyte-4699bfbf-b765-4b38-b514-14c9c33e2383" acquired by "delete_volume" :: waited 0.040s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ec0bf5-e26c-4205-b456-0d24bd2f4887]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:57 devstack sudo[100249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383
Nov 03 08:10:57 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:57 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c 1073741824" returned: 0 in 0.629s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=152,cinder:INSERT=40,cinder:DELETE=14,cinder:SELECT=137 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:57 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c
Nov 03 08:10:57 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:57 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383" returned: 0 in 0.448s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:57 devstack sudo[100257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383
Nov 03 08:10:57 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:57 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c" returned: 0 in 0.297s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Attempting download of 428fc5de-21dc-48af-88b5-ae68769717e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/428fc5de-21dc-48af-88b5-ae68769717e9', 'metadata': {}}])) to volume c5f57ee2-f9d3-451b-9cc0-06850884165c. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b949339-b9d2-486d-b4d0-ef0d393586e9]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_428fc5de-21dc-48af-88b5-ae68769717e9_ud7wuyvj {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:57 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4699bfbf-b765-4b38-b514-14c9c33e2383" returned: 0 in 0.304s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:57 devstack sudo[100260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_428fc5de-21dc-48af-88b5-ae68769717e9_ud7wuyvj
Nov 03 08:10:57 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Lock "cinder-quobyte-4699bfbf-b765-4b38-b514-14c9c33e2383" released by "delete_volume" :: held 0.875s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:10:57 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Created reservations ['4f4b4af2-9f1b-4297-b065-662b41c069a3'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Created reservations ['e87d5f3a-a476-45c4-959c-8a31e611fec9', 'e8272144-17ec-4dd1-87ad-34d1ab2adba2', 'ca9fc098-07ae-4709-b39f-fd786c3a0403', '65f4856e-a91e-4896-9163-41e88ccf3868'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:10:58 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_428fc5de-21dc-48af-88b5-ae68769717e9_ud7wuyvj" returned: 0 in 0.428s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_428fc5de-21dc-48af-88b5-ae68769717e9_ud7wuyvj {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:58 devstack sudo[100266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:10:58 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:58 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_428fc5de-21dc-48af-88b5-ae68769717e9_ud7wuyvj
Nov 03 08:10:58 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:58 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.330s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:10:58 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_428fc5de-21dc-48af-88b5-ae68769717e9_ud7wuyvj" returned: 1 in 0.438s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_428fc5de-21dc-48af-88b5-ae68769717e9_ud7wuyvj' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:10:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5cd43cfb-5e0b-428e-9ab7-228f9302466d tempest-GroupsV314Test-793160574 None] Delete group completed successfully.
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[840eaf03-e4b5-4b3c-8cc7-b47618af34ba]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:58 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD
Nov 03 08:10:58 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:10:58 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] 428fc5de-21dc-48af-88b5-ae68769717e9 was qcow2, converting to qcow2 {{(pid=86851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 08:10:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:10:58 devstack sudo[100278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c
Nov 03 08:10:58 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Acquiring lock "cinder-1f1f6074-3149-4aac-9fd7-036c00540f85-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Lock "cinder-1f1f6074-3149-4aac-9fd7-036c00540f85-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Acquiring lock "cinder-quobyte-1f1f6074-3149-4aac-9fd7-036c00540f85" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Lock "cinder-quobyte-1f1f6074-3149-4aac-9fd7-036c00540f85" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:01 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[095c63d4-01de-4548-907a-13d9051d3720]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:01 devstack sudo[100287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85
Nov 03 08:11:01 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:01 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c" returned: 0 in 2.857s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:01 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_428fc5de-21dc-48af-88b5-ae68769717e9_khysz910devstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:11:01 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Converted 112.00 MB image at 39.18 MB/s
Nov 03 08:11:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:01 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c 1G
Nov 03 08:11:01 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:02 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85" returned: 0 in 0.509s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:02 devstack sudo[100294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85
Nov 03 08:11:02 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:02 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c 1G" returned: 0 in 0.497s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Downloaded image 428fc5de-21dc-48af-88b5-ae68769717e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/428fc5de-21dc-48af-88b5-ae68769717e9', 'metadata': {}}])) to volume c5f57ee2-f9d3-451b-9cc0-06850884165c successfully. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Temporary image 428fc5de-21dc-48af-88b5-ae68769717e9 for user 0925b3da832e4558b88b921fe8d9c826 is deleted. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Marking volume c5f57ee2-f9d3-451b-9cc0-06850884165c as bootable. {{(pid=86851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Copying metadata from image 428fc5de-21dc-48af-88b5-ae68769717e9 to c5f57ee2-f9d3-451b-9cc0-06850884165c. {{(pid=86851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Creating volume glance metadata for volume c5f57ee2-f9d3-451b-9cc0-06850884165c backed by image 428fc5de-21dc-48af-88b5-ae68769717e9 with: {'image_id': '428fc5de-21dc-48af-88b5-ae68769717e9', 'image_name': 'tempest-scenario-img--291806693', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 08:11:02 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5732dbb-85e4-45a6-8a85-c241ab22c327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f57ee2-f9d3-451b-9cc0-06850884165c', 'volume_size': 1, 'image_id': '428fc5de-21dc-48af-88b5-ae68769717e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/428fc5de-21dc-48af-88b5-ae68769717e9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--291806693', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c31d8666de54532b3597422ae27e3ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '428fc5de-21dc-48af-88b5-ae68769717e9', 'created_at': datetime.datetime(2026, 11, 3, 7, 10, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 10, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/428fc5de-21dc-48af-88b5-ae68769717e9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466faa8320>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337079aa-f72f-428e-a6a2-f5a02e50e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1f1f6074-3149-4aac-9fd7-036c00540f85" returned: 0 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:02 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Volume volume-c5f57ee2-f9d3-451b-9cc0-06850884165c (c5f57ee2-f9d3-451b-9cc0-06850884165c): created successfully
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337079aa-f72f-428e-a6a2-f5a02e50e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Flow 'volume_create_manager' (f2cb6d22-2110-4bcc-b694-f842cb8b5c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Lock "cinder-quobyte-1f1f6074-3149-4aac-9fd7-036c00540f85" released by "delete_volume" :: held 0.981s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7870d335-1c7b-4e44-9247-6f8674625db8 tempest-TestInstancesWithCinderVolumes-685174399 None] Created volume successfully.
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Created reservations ['2dc585c4-eed2-4ede-9fa3-c62d594adf6c', 'f0e2c573-a2b6-4b03-bbe8-f1b3d685e612', '529c0bde-530f-40f1-b631-1783dac4b19a', 'fc1e879b-9404-47a2-b6a7-e02319a08d57'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:02 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:11:02 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:02 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.263s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:11:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Deleted volume successfully.
Nov 03 08:11:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-805ba4dd-c79d-4c86-9ecc-7b759ee846fa tempest-VolumesNegativeTest-1715954613 None] Lock "cinder-1f1f6074-3149-4aac-9fd7-036c00540f85-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:03 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:11:03 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:03 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.272s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:11:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:11:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-7bd6159e-1bf7-4fa2-a64c-ecac7d693990 req-0f5eb9eb-d9db-4286-9d41-63ee25606494 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-7bd6159e-1bf7-4fa2-a64c-ecac7d693990 req-0f5eb9eb-d9db-4286-9d41-63ee25606494 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-7bd6159e-1bf7-4fa2-a64c-ecac7d693990 req-0f5eb9eb-d9db-4286-9d41-63ee25606494 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-7bd6159e-1bf7-4fa2-a64c-ecac7d693990 req-0f5eb9eb-d9db-4286-9d41-63ee25606494 tempest-TestInstancesWithCinderVolumes-685174399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-c5f57ee2-f9d3-451b-9cc0-06850884165c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0b8d44b-241b-4337-ac58-a801c25a8768', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:11:07 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-7bd6159e-1bf7-4fa2-a64c-ecac7d693990 req-0f5eb9eb-d9db-4286-9d41-63ee25606494 tempest-TestInstancesWithCinderVolumes-685174399 None] attachment_update completed successfully.
Nov 03 08:11:12 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:11:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Flow 'volume_create_manager' (5eee1327-ec9c-4466-b634-6fc036312b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df61635-418b-4272-a363-71712dc56bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df61635-418b-4272-a363-71712dc56bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1ad67e-8e8e-4855-8d37-16db4086727e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612b974035aa45d2b1c30c6f9b8398a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:13Z,use_quota=True,user_id='4f4dc5b69ea64a5d99adfb5b48714d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e738a11d-2104-45a8-8afa-d58761729437),volume_type_id=e738a11d-2104-45a8-8afa-d58761729437)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd25ec1a-9296-424c-a1c4-85fab1514132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd25ec1a-9296-424c-a1c4-85fab1514132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b902863c-1e77-46c0-82f2-391924a3c93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:12 devstack cinder-volume[86851]: DEBUG cinder.image.glance [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Creating Keystone auth plugin from conf {{(pid=86851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 08:11:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b902863c-1e77-46c0-82f2-391924a3c93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f1ad67e-8e8e-4855-8d37-16db4086727e', 'volume_name': 'volume-9f1ad67e-8e8e-4855-8d37-16db4086727e', 'volume_size': 1, 'image_id': 'b20849ce-8106-4d06-9192-16121d3ae57e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b20849ce-8106-4d06-9192-16121d3ae57e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '868680f254bb35e0a4a59b2842e615d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '612b974035aa45d2b1c30c6f9b8398a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88e75a0a65867a8a0ab0532a528b511960c00b8ab3410567d50444f5c1a6b846ddaf997620894139178b257a46a92a535470300c56d5f0b69a501aac66b7689c', 'id': 'b20849ce-8106-4d06-9192-16121d3ae57e', 'created_at': datetime.datetime(2026, 11, 3, 7, 11, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 11, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b20849ce-8106-4d06-9192-16121d3ae57e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466faabf50>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974ae361-e092-457c-8670-dfa00f4ceb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974ae361-e092-457c-8670-dfa00f4ceb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f4f97a-5368-44b7-92f0-9c0a55272b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Volume 9f1ad67e-8e8e-4855-8d37-16db4086727e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f1ad67e-8e8e-4855-8d37-16db4086727e', 'volume_size': 1, 'image_id': 'b20849ce-8106-4d06-9192-16121d3ae57e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b20849ce-8106-4d06-9192-16121d3ae57e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '868680f254bb35e0a4a59b2842e615d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '612b974035aa45d2b1c30c6f9b8398a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88e75a0a65867a8a0ab0532a528b511960c00b8ab3410567d50444f5c1a6b846ddaf997620894139178b257a46a92a535470300c56d5f0b69a501aac66b7689c', 'id': 'b20849ce-8106-4d06-9192-16121d3ae57e', 'created_at': datetime.datetime(2026, 11, 3, 7, 11, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 11, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b20849ce-8106-4d06-9192-16121d3ae57e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466faabf50>}
Nov 03 08:11:13 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Trying to clone 9f1ad67e-8e8e-4855-8d37-16db4086727e from image b20849ce-8106-4d06-9192-16121d3ae57e at location (None, [{'url': 'file:///opt/stack/data/glance/images/b20849ce-8106-4d06-9192-16121d3ae57e', 'metadata': {}}]). {{(pid=86851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 08:11:13 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 08:11:13 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 08:11:13 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fe1c60-80e1-4b78-8104-04d1a722c933]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:13 devstack sudo[100800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD
Nov 03 08:11:13 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:14 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:14 devstack sudo[100804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD
Nov 03 08:11:14 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:14 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD" returned: 1 in 0.487s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:11:14 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Temporary image b20849ce-8106-4d06-9192-16121d3ae57e is fetched for user 4f4dc5b69ea64a5d99adfb5b48714d4b. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 08:11:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4feff19-d970-42c1-a38e-37012b25d286]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:15 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD
Nov 03 08:11:15 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:15 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:15 devstack sudo[100814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD
Nov 03 08:11:15 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:16 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD" returned: 1 in 0.782s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1ad67e-8e8e-4855-8d37-16db4086727e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612b974035aa45d2b1c30c6f9b8398a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:13Z,use_quota=True,user_id='4f4dc5b69ea64a5d99adfb5b48714d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e738a11d-2104-45a8-8afa-d58761729437),volume_type_id=e738a11d-2104-45a8-8afa-d58761729437)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Creating volume 9f1ad67e-8e8e-4855-8d37-16db4086727e {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:11:16 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:11:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:16 devstack sudo[100819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e 1073741824
Nov 03 08:11:16 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:17 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e 1073741824" returned: 0 in 0.915s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:17 devstack sudo[100825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e
Nov 03 08:11:17 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:17 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e" returned: 0 in 0.491s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:11:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:17 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Attempting download of b20849ce-8106-4d06-9192-16121d3ae57e ((None, [{'url': 'file:///opt/stack/data/glance/images/b20849ce-8106-4d06-9192-16121d3ae57e', 'metadata': {}}])) to volume 9f1ad67e-8e8e-4855-8d37-16db4086727e. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 08:11:18 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd5f39e-85f4-434c-bcef-71713abcd4e3]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b20849ce-8106-4d06-9192-16121d3ae57e_8fsrsoc5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:18 devstack sudo[100834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b20849ce-8106-4d06-9192-16121d3ae57e_8fsrsoc5
Nov 03 08:11:18 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:18 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b20849ce-8106-4d06-9192-16121d3ae57e_8fsrsoc5" returned: 0 in 0.656s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b20849ce-8106-4d06-9192-16121d3ae57e_8fsrsoc5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:18 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b20849ce-8106-4d06-9192-16121d3ae57e_8fsrsoc5
Nov 03 08:11:18 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:19 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b20849ce-8106-4d06-9192-16121d3ae57e_8fsrsoc5" returned: 1 in 0.509s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b20849ce-8106-4d06-9192-16121d3ae57e_8fsrsoc5' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:11:19 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7776016f-fc0e-4490-b2c0-ae6cc6d439dc]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:19 devstack sudo[100844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD
Nov 03 08:11:19 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:19 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD" returned: 0 in 0.570s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:20 devstack sudo[100848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD
Nov 03 08:11:20 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:20 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD" returned: 1 in 0.494s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:11:20 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] b20849ce-8106-4d06-9192-16121d3ae57e was raw, converting to qcow2 {{(pid=86851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 08:11:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:20 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e
Nov 03 08:11:20 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:21 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e" returned: 0 in 0.758s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:21 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b20849ce-8106-4d06-9192-16121d3ae57e_03yfbt51devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:11:21 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 08:11:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:21 devstack sudo[100860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e 1G
Nov 03 08:11:21 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:21 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e 1G" returned: 0 in 0.732s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:21 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Downloaded image b20849ce-8106-4d06-9192-16121d3ae57e ((None, [{'url': 'file:///opt/stack/data/glance/images/b20849ce-8106-4d06-9192-16121d3ae57e', 'metadata': {}}])) to volume 9f1ad67e-8e8e-4855-8d37-16db4086727e successfully. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 08:11:21 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Temporary image b20849ce-8106-4d06-9192-16121d3ae57e for user 4f4dc5b69ea64a5d99adfb5b48714d4b is deleted. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 08:11:21 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Marking volume 9f1ad67e-8e8e-4855-8d37-16db4086727e as bootable. {{(pid=86851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 08:11:21 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Copying metadata from image b20849ce-8106-4d06-9192-16121d3ae57e to 9f1ad67e-8e8e-4855-8d37-16db4086727e. {{(pid=86851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 08:11:21 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Creating volume glance metadata for volume 9f1ad67e-8e8e-4855-8d37-16db4086727e backed by image b20849ce-8106-4d06-9192-16121d3ae57e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b20849ce-8106-4d06-9192-16121d3ae57e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '868680f254bb35e0a4a59b2842e615d9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 08:11:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f4f97a-5368-44b7-92f0-9c0a55272b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1ad67e-8e8e-4855-8d37-16db4086727e', 'volume_size': 1, 'image_id': 'b20849ce-8106-4d06-9192-16121d3ae57e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b20849ce-8106-4d06-9192-16121d3ae57e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '868680f254bb35e0a4a59b2842e615d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '612b974035aa45d2b1c30c6f9b8398a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88e75a0a65867a8a0ab0532a528b511960c00b8ab3410567d50444f5c1a6b846ddaf997620894139178b257a46a92a535470300c56d5f0b69a501aac66b7689c', 'id': 'b20849ce-8106-4d06-9192-16121d3ae57e', 'created_at': datetime.datetime(2026, 11, 3, 7, 11, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 11, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b20849ce-8106-4d06-9192-16121d3ae57e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466faabf50>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf11ae1-795a-49db-b419-fe2c87eb7beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:22 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Volume volume-9f1ad67e-8e8e-4855-8d37-16db4086727e (9f1ad67e-8e8e-4855-8d37-16db4086727e): created successfully
Nov 03 08:11:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf11ae1-795a-49db-b419-fe2c87eb7beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Flow 'volume_create_manager' (5eee1327-ec9c-4466-b634-6fc036312b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-dca2003e-0ecb-4814-a950-99d03571a62d tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Created volume successfully.
Nov 03 08:11:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Acquiring lock "cinder-9f1ad67e-8e8e-4855-8d37-16db4086727e-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Lock "cinder-9f1ad67e-8e8e-4855-8d37-16db4086727e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Acquiring lock "cinder-quobyte-9f1ad67e-8e8e-4855-8d37-16db4086727e" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Lock "cinder-quobyte-9f1ad67e-8e8e-4855-8d37-16db4086727e" acquired by "delete_volume" :: waited 0.034s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3af4c8b-ab26-4a3e-901c-7a85c17db48c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:11:23 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e
Nov 03 08:11:23 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Flow 'volume_create_manager' (1ef8cf28-3234-4228-a568-9edefaee1712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8941097f-ea2a-4937-93dc-a3eff2214ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8941097f-ea2a-4937-93dc-a3eff2214ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-602866968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c2f11fa9b44999a5ed56713ba824f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:23Z,use_quota=True,user_id='c491a222033047f9a6f6ace4813567de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3869b5a-2aa4-4353-b0c9-c8fa001dc885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3869b5a-2aa4-4353-b0c9-c8fa001dc885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13664fc8-3a02-4915-9aa2-b5d32dbd0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13664fc8-3a02-4915-9aa2-b5d32dbd0937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5', 'volume_name': 'volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292d79e2-41a9-4e3b-979f-abd8cfa51f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292d79e2-41a9-4e3b-979f-abd8cfa51f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e23e41-2387-4487-9c3c-641bf1bbbd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:23 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Volume a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5', 'volume_size': 1}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-602866968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c2f11fa9b44999a5ed56713ba824f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:23Z,use_quota=True,user_id='c491a222033047f9a6f6ace4813567de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Creating volume a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:11:23 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:23 devstack sudo[100868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5 1073741824
Nov 03 08:11:23 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:23 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e" returned: 0 in 0.543s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:23 devstack sudo[100873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e
Nov 03 08:11:23 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:24 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9f1ad67e-8e8e-4855-8d37-16db4086727e" returned: 0 in 0.440s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Lock "cinder-quobyte-9f1ad67e-8e8e-4855-8d37-16db4086727e" released by "delete_volume" :: held 1.049s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:24 devstack cinder-volume[86851]: WARNING cinder.quota [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:11:24 devstack cinder-volume[86851]: WARNING cinder.quota [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Created reservations ['c1555b41-e44f-4903-af8d-6add710f6643', '591b41dc-2b1e-4461-a874-8fa8e8b61ec4', '90020edc-09bd-4196-88b6-3e6325b66bb3', '450fb991-8d95-4b9e-bec6-6f5973dfe8fb'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:24 devstack sudo[100881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:11:24 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:24 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5 1073741824" returned: 0 in 1.029s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:24 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5
Nov 03 08:11:24 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:24 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.617s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:24 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:11:24 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Deleted volume successfully.
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b632dfa4-2f63-43aa-addd-540e09a09160 tempest-VolumeAndVolumeTypeFromImageTest-673060393 None] Lock "cinder-9f1ad67e-8e8e-4855-8d37-16db4086727e-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:25 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5" returned: 0 in 0.619s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e23e41-2387-4487-9c3c-641bf1bbbd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2a97c9-dd87-4b7f-beac-94132c9620af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:25 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Volume volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5 (a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5): created successfully
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2a97c9-dd87-4b7f-beac-94132c9620af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Flow 'volume_create_manager' (1ef8cf28-3234-4228-a568-9edefaee1712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-bc8b9561-f2fc-45ad-ac3e-cf9024be8ef8 tempest-VolumeQuotasAdminTestJSON-121082004 None] Created volume successfully.
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Flow 'volume_create_manager' (8f68e7f2-5e1d-482a-b880-403342e0d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fcdf50c-635e-4351-94ce-0c4121e3ab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fcdf50c-635e-4351-94ce-0c4121e3ab98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-198278484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbf0c9b-2dab-4434-8da3-81fa888938ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8903091ff4923a95c00ad3fc0c3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:25Z,use_quota=True,user_id='27f04e5bb4ae4a1d8cdca377e0a9a1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25dee7b-c3af-488d-872a-1e9a290371c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25dee7b-c3af-488d-872a-1e9a290371c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db33139b-cb7d-4eb3-aca5-f4ab5bfcbb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db33139b-cb7d-4eb3-aca5-f4ab5bfcbb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cbf0c9b-2dab-4434-8da3-81fa888938ad', 'volume_name': 'volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021aec5f-9c89-4fa9-a9f6-92f232de61b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021aec5f-9c89-4fa9-a9f6-92f232de61b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24dcf11-9084-4d5a-a827-1090a073ffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:25 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume 6cbf0c9b-2dab-4434-8da3-81fa888938ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad', 'volume_size': 1}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-198278484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbf0c9b-2dab-4434-8da3-81fa888938ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8903091ff4923a95c00ad3fc0c3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:25Z,use_quota=True,user_id='27f04e5bb4ae4a1d8cdca377e0a9a1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Creating volume 6cbf0c9b-2dab-4434-8da3-81fa888938ad {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:11:25 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:11:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:25 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad 1073741824
Nov 03 08:11:25 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:26 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad 1073741824" returned: 0 in 0.727s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:26 devstack sudo[100896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad
Nov 03 08:11:26 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Acquiring lock "cinder-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "cinder-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Acquiring lock "cinder-quobyte-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "cinder-quobyte-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf76902-6b63-4a59-a4df-f9e408c44bca]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:26 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:26 devstack sudo[100898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5
Nov 03 08:11:26 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad" returned: 0 in 0.546s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24dcf11-9084-4d5a-a827-1090a073ffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e847a4e-0106-4b8e-b5cb-3f449ee89dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:26 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad (6cbf0c9b-2dab-4434-8da3-81fa888938ad): created successfully
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e847a4e-0106-4b8e-b5cb-3f449ee89dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Flow 'volume_create_manager' (8f68e7f2-5e1d-482a-b880-403342e0d756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:26 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4b6fe469-ce07-48a1-ac84-db83ee1d4eb7 tempest-VolumesSnapshotTestJSON-1805349623 None] Created volume successfully.
Nov 03 08:11:27 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5" returned: 0 in 0.718s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:27 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5
Nov 03 08:11:27 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:27 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5" returned: 0 in 0.536s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "cinder-quobyte-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5" released by "delete_volume" :: held 1.316s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Created reservations ['e30eaa87-295b-4f12-a84d-026c9728b168', 'ae14cb7a-3814-4576-8dc0-803816f0935b', 'd5cc79cd-68c0-45a9-89b3-90e68d5b328d', 'be760e7c-aed9-41c3-acb9-f49ff8b3c735'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:28 devstack sudo[100907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:11:28 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Creating offline snapshot 889b6089-55a7-468d-a066-728cb5379a47 of volume 6cbf0c9b-2dab-4434-8da3-81fa888938ad {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[918b8536-652a-4d70-af3c-08cec27fa77e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:28 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.367s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:11:28 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Deleted volume successfully.
Nov 03 08:11:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-152717f4-d4e8-4297-8669-76811a32e306 tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "cinder-a7b4a5f8-b8d9-4d5d-84b9-29a1b45011b5-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:28 devstack sudo[100909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad
Nov 03 08:11:28 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:29 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad" returned: 0 in 0.763s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:29 devstack sudo[100918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47 1G
Nov 03 08:11:29 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:29 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47 1G" returned: 0 in 0.723s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:29 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47
Nov 03 08:11:29 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Flow 'volume_create_manager' (815fa07c-c1c4-4e63-b241-baaf464bd222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5ec699-960e-490d-b376-b90e6842b7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5ec699-960e-490d-b376-b90e6842b7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1421711914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbee7927-3f5b-4611-83b7-c8a4a33eb114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c2f11fa9b44999a5ed56713ba824f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:30Z,use_quota=True,user_id='c491a222033047f9a6f6ace4813567de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5075a1-efea-4a17-a5ff-6b19869088ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5075a1-efea-4a17-a5ff-6b19869088ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac5e7d6-1936-4e83-913e-849d4855616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac5e7d6-1936-4e83-913e-849d4855616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbee7927-3f5b-4611-83b7-c8a4a33eb114', 'volume_name': 'volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636b6fda-8385-4e76-8244-01bb4c8738d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636b6fda-8385-4e76-8244-01bb4c8738d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a44c6a-9398-4e76-97b6-e8dd3b8eb063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:30 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Volume cbee7927-3f5b-4611-83b7-c8a4a33eb114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114', 'volume_size': 1}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:30 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47" returned: 0 in 0.430s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:30 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47 is being set with open permissions: ugo+rw
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:30 devstack sudo[100942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47
Nov 03 08:11:30 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:30 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47" returned: 0 in 0.389s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:30 devstack sudo[100960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.info
Nov 03 08:11:30 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:31 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.info" returned: 0 in 0.391s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:31 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.info is being set with open permissions: ugo+rw
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:31 devstack sudo[100973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.info
Nov 03 08:11:31 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:31 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.info" returned: 0 in 0.366s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.244s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1421711914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbee7927-3f5b-4611-83b7-c8a4a33eb114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c2f11fa9b44999a5ed56713ba824f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:30Z,use_quota=True,user_id='c491a222033047f9a6f6ace4813567de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Creating volume cbee7927-3f5b-4611-83b7-c8a4a33eb114 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:11:31 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:11:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:31 devstack sudo[100976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114 1073741824
Nov 03 08:11:31 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:31 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-dce93132-0e93-4460-b572-6581f7ba2e88 tempest-VolumesSnapshotTestJSON-1805349623 None] Create snapshot completed successfully
Nov 03 08:11:32 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114 1073741824" returned: 0 in 0.458s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:32 devstack sudo[100982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114
Nov 03 08:11:32 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:32 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114" returned: 0 in 0.259s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a44c6a-9398-4e76-97b6-e8dd3b8eb063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8c9715-76ec-44e5-868f-59d1ec9ccde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:32 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Volume volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114 (cbee7927-3f5b-4611-83b7-c8a4a33eb114): created successfully
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8c9715-76ec-44e5-868f-59d1ec9ccde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Flow 'volume_create_manager' (815fa07c-c1c4-4e63-b241-baaf464bd222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:32 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ef6dd546-5761-4ef8-b714-2129d467c23c tempest-VolumeQuotasAdminTestJSON-121082004 None] Created volume successfully.
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-889b6089-55a7-468d-a066-728cb5379a47-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-889b6089-55a7-468d-a066-728cb5379a47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-6cbf0c9b-2dab-4434-8da3-81fa888938ad" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Flow 'volume_create_manager' (79434e31-3f13-470a-846f-a96398559a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457d0600-a705-4593-bdc2-4d40177498c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-6cbf0c9b-2dab-4434-8da3-81fa888938ad" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-889b6089-55a7-468d-a066-728cb5379a47" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457d0600-a705-4593-bdc2-4d40177498c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-218692745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baff6bebe4cc4afc9cd2bced86691230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:33Z,use_quota=True,user_id='d17b15f5bc6348219ce74fc4f34ca7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca70ef4f-751c-43b1-a967-7eacf030e050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca70ef4f-751c-43b1-a967-7eacf030e050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70a58dd-f7f9-44d8-98d6-519c93a5bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70a58dd-f7f9-44d8-98d6-519c93a5bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b6f9f3-e74f-47ad-a4e1-45f49f4cc324', 'volume_name': 'volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765b630d-8adc-4ddc-8343-b6fce6cfd404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765b630d-8adc-4ddc-8343-b6fce6cfd404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d497922e-8ed0-404c-a9f1-c80dff6831a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:32 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Volume d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324', 'volume_size': 1}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-218692745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baff6bebe4cc4afc9cd2bced86691230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:33Z,use_quota=True,user_id='d17b15f5bc6348219ce74fc4f34ca7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Creating volume d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:11:32 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-889b6089-55a7-468d-a066-728cb5379a47" acquired by "_delete_snapshot" :: waited 0.081s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Deleting offline snapshot 889b6089-55a7-468d-a066-728cb5379a47 of volume 6cbf0c9b-2dab-4434-8da3-81fa888938ad {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:11:32 devstack sudo[100985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 1073741824
Nov 03 08:11:32 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] snapshot_file for this snap is: volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7af695-ee3a-4a20-9251-792e65b67209]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:33 devstack sudo[100987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47
Nov 03 08:11:33 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:33 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47" returned: 0 in 0.423s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f815b83c-6567-49c2-9ef7-da11be85c423]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:33 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 1073741824" returned: 0 in 0.530s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:33 devstack sudo[100996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324
Nov 03 08:11:33 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:33 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad
Nov 03 08:11:33 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:33 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1689aa49-696d-4f9c-a834-adaef87a40c6 tempest-VolumeQuotasAdminTestJSON-738463858 None] Transfer volume completed successfully.
Nov 03 08:11:33 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d497922e-8ed0-404c-a9f1-c80dff6831a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018ecfc6-07e8-492b-8d57-4b110587d55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:33 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Volume volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 (d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324): created successfully
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018ecfc6-07e8-492b-8d57-4b110587d55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Flow 'volume_create_manager' (79434e31-3f13-470a-846f-a96398559a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:33 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d2fb7b52-c201-4f55-ac49-4a5a843fdd6c tempest-VolumeDependencyTests-233692846 None] Created volume successfully.
Nov 03 08:11:33 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad" returned: 0 in 0.429s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:33 devstack sudo[101004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47
Nov 03 08:11:33 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Acquiring lock "cinder-cbee7927-3f5b-4611-83b7-c8a4a33eb114-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:34 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47" returned: 0 in 0.389s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Lock "cinder-cbee7927-3f5b-4611-83b7-c8a4a33eb114-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:34 devstack sudo[101044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47
Nov 03 08:11:34 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Acquiring lock "cinder-quobyte-cbee7927-3f5b-4611-83b7-c8a4a33eb114" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Lock "cinder-quobyte-cbee7927-3f5b-4611-83b7-c8a4a33eb114" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f787a7-fe34-4355-8ebe-617dd3fbe934]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:34 devstack sudo[101046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114
Nov 03 08:11:34 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:34 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad.889b6089-55a7-468d-a066-728cb5379a47" returned: 0 in 0.282s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-889b6089-55a7-468d-a066-728cb5379a47" released by "_delete_snapshot" :: held 1.647s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-6cbf0c9b-2dab-4434-8da3-81fa888938ad" released by "delete_snapshot" :: held 1.736s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Created reservations ['95a1631c-d82d-4b5c-a6ad-cb79235d262d', '8a3e5b16-9b7b-466c-8fe6-0337570c1d32', '7cb43cb0-8f11-4b6e-93cd-eed79b93c196', '9aeac10a-3838-4def-a177-e15ed5eea7ff'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:11:34 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Delete snapshot completed successfully.
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c011863-a717-4820-84c8-bf49886eda01 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-889b6089-55a7-468d-a066-728cb5379a47-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:34 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114" returned: 0 in 0.382s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:34 devstack sudo[101054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114
Nov 03 08:11:34 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:34 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cbee7927-3f5b-4611-83b7-c8a4a33eb114" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Lock "cinder-quobyte-cbee7927-3f5b-4611-83b7-c8a4a33eb114" released by "delete_volume" :: held 0.710s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Creating offline snapshot c8924b49-a7f4-49ab-9d9f-14a044b0f61e of volume d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Created reservations ['2d9bccc1-b912-4e6e-b3dd-9a47bc5a6ee1', '692b9818-7aa4-49e0-95a2-473c281771ed', 'fac2203c-7d8a-45df-bcf6-2afd44cc4c92', 'f02e9620-99b4-4b8e-9d86-a7e167cf5e15'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2ab777-7d01-42a0-857c-4327cd396946]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:35 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:11:35 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:35 devstack sudo[101057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324
Nov 03 08:11:35 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Flow 'volume_create_manager' (9cd6ffd3-ab26-4367-bd72-2e049e45d3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdc4e3b-7313-4409-aabb-ef9e833f47a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdc4e3b-7313-4409-aabb-ef9e833f47a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1459645713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7782225d-7e72-4ab5-8e31-7772f07cc753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8903091ff4923a95c00ad3fc0c3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:35Z,use_quota=True,user_id='27f04e5bb4ae4a1d8cdca377e0a9a1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8f1df0-456f-4fd1-8cd0-87722c4d1181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:35 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8f1df0-456f-4fd1-8cd0-87722c4d1181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3dd158-a224-4179-9104-a630ceeadca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3dd158-a224-4179-9104-a630ceeadca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7782225d-7e72-4ab5-8e31-7772f07cc753', 'volume_name': 'volume-7782225d-7e72-4ab5-8e31-7772f07cc753', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8269a51-5545-4477-9919-3a65b163931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8269a51-5545-4477-9919-3a65b163931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:35 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31284e76-6042-42ed-bbe1-201e09d339ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:35 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume 7782225d-7e72-4ab5-8e31-7772f07cc753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7782225d-7e72-4ab5-8e31-7772f07cc753', 'volume_size': 1}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.360s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" returned: 0 in 0.478s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Deleted volume successfully.
Nov 03 08:11:35 devstack sudo[101065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e 1G
Nov 03 08:11:35 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7709d1de-9ed5-4fd3-ac3b-d00efc5a4315 tempest-VolumeQuotasAdminTestJSON-970065992 None] Lock "cinder-cbee7927-3f5b-4611-83b7-c8a4a33eb114-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:35 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e 1G" returned: 0 in 0.438s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:36 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e
Nov 03 08:11:36 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:36 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e" returned: 0 in 0.315s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:36 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e is being set with open permissions: ugo+rw
Nov 03 08:11:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:36 devstack sudo[101076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e
Nov 03 08:11:36 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:36 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e" returned: 0 in 0.256s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:36 devstack sudo[101079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.info
Nov 03 08:11:36 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:36 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.info" returned: 0 in 0.260s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:36 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.info is being set with open permissions: ugo+rw
Nov 03 08:11:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:36 devstack sudo[101082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.info
Nov 03 08:11:36 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:37 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.info" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.590s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1459645713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7782225d-7e72-4ab5-8e31-7772f07cc753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8903091ff4923a95c00ad3fc0c3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:35Z,use_quota=True,user_id='27f04e5bb4ae4a1d8cdca377e0a9a1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Creating volume 7782225d-7e72-4ab5-8e31-7772f07cc753 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:11:37 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:37 devstack sudo[101085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 1073741824
Nov 03 08:11:37 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:37 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e05ca00a-c162-448e-99a6-6bdb9e258480 tempest-VolumeDependencyTests-233692846 None] Create snapshot completed successfully
Nov 03 08:11:37 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 1073741824" returned: 0 in 0.478s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:37 devstack sudo[101090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753
Nov 03 08:11:37 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:37 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753" returned: 0 in 0.288s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31284e76-6042-42ed-bbe1-201e09d339ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7782225d-7e72-4ab5-8e31-7772f07cc753', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82314261-7e18-423a-a645-9996b1012290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:37 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume volume-7782225d-7e72-4ab5-8e31-7772f07cc753 (7782225d-7e72-4ab5-8e31-7772f07cc753): created successfully
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82314261-7e18-423a-a645-9996b1012290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Flow 'volume_create_manager' (9cd6ffd3-ab26-4367-bd72-2e049e45d3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:38 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-84a264c6-86c5-45e0-a0de-226286bd60e4 tempest-VolumesSnapshotTestJSON-1805349623 None] Created volume successfully.
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Flow 'volume_create_manager' (89c9473e-8b26-4527-a2ae-706d44f60c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda8ccf1-e9d3-4bd7-81b1-56adf8a3186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda8ccf1-e9d3-4bd7-81b1-56adf8a3186c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1227274519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25931b25-1f33-4510-aa9e-0ab9ffe0eb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baff6bebe4cc4afc9cd2bced86691230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8924b49-a7f4-49ab-9d9f-14a044b0f61e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:39Z,use_quota=True,user_id='d17b15f5bc6348219ce74fc4f34ca7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea3b4c5-8537-4780-b279-025d0ba20e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea3b4c5-8537-4780-b279-025d0ba20e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33022f4-127f-4737-bd6b-c3fc76afcf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33022f4-127f-4737-bd6b-c3fc76afcf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25931b25-1f33-4510-aa9e-0ab9ffe0eb14', 'volume_name': 'volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14', 'volume_size': 1, 'snapshot_id': 'c8924b49-a7f4-49ab-9d9f-14a044b0f61e'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0121ab32-3305-4458-8d65-2fb17416939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0121ab32-3305-4458-8d65-2fb17416939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c8cd2d-597c-4169-800d-16a62b9b3829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:38 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Volume 25931b25-1f33-4510-aa9e-0ab9ffe0eb14: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14', 'volume_size': 1, 'snapshot_id': 'c8924b49-a7f4-49ab-9d9f-14a044b0f61e'}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Creating offline snapshot f39515ab-c194-4709-9f05-e43e5cfb8057 of volume 7782225d-7e72-4ab5-8e31-7772f07cc753 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:11:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:39 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3c1d97-c7e6-4250-9836-77e4d6253d42]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:39 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753
Nov 03 08:11:39 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:39 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753" returned: 0 in 0.400s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:39 devstack sudo[101099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 1G
Nov 03 08:11:39 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:39 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 1G" returned: 0 in 0.513s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7782225d-7e72-4ab5-8e31-7772f07cc753 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:39 devstack sudo[101104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7782225d-7e72-4ab5-8e31-7772f07cc753 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057
Nov 03 08:11:39 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:40 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7782225d-7e72-4ab5-8e31-7772f07cc753 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057" returned: 0 in 0.363s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:40 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 is being set with open permissions: ugo+rw
Nov 03 08:11:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:40 devstack sudo[101110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057
Nov 03 08:11:40 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:40 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057" returned: 0 in 0.256s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:40 devstack sudo[101114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.info
Nov 03 08:11:40 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:40 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.info" returned: 0 in 0.287s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:40 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.info is being set with open permissions: ugo+rw
Nov 03 08:11:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:40 devstack sudo[101117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.info
Nov 03 08:11:40 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:41 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.info" returned: 0 in 0.284s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.199s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Acquiring lock "cinder-quobyte-c8924b49-a7f4-49ab-9d9f-14a044b0f61e-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" by "_create_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-c8924b49-a7f4-49ab-9d9f-14a044b0f61e-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Creating volume 25931b25-1f33-4510-aa9e-0ab9ffe0eb14 from snapshot c8924b49-a7f4-49ab-9d9f-14a044b0f61e {{(pid=86851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Acquiring lock "cinder-quobyte-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:41 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-df927590-bdfb-4190-8149-78aac0cb04cd tempest-VolumesSnapshotTestJSON-1805349623 None] Create snapshot completed successfully
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] snapshot: c8924b49-a7f4-49ab-9d9f-14a044b0f61e, volume: 25931b25-1f33-4510-aa9e-0ab9ffe0eb14,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eae15a-0cb6-487e-92bd-fb080139cea4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:41 devstack sudo[101120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e
Nov 03 08:11:41 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:41 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e" returned: 0 in 0.413s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[40afe9e4-c5e3-41c3-b905-dd4f43d709f5]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:41 devstack sudo[101125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324
Nov 03 08:11:41 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:42 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" returned: 0 in 0.519s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14 not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:42 devstack sudo[101130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14
Nov 03 08:11:42 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Flow 'volume_create_manager' (a9fc67ab-4c3f-4472-b2bb-87dc17cbc26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d6080e-e172-4d92-b15d-8d63bb2f5c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d6080e-e172-4d92-b15d-8d63bb2f5c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-626726716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e864e1-adcb-4a80-b5c4-1be140538902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8903091ff4923a95c00ad3fc0c3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f39515ab-c194-4709-9f05-e43e5cfb8057,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:43Z,use_quota=True,user_id='27f04e5bb4ae4a1d8cdca377e0a9a1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a402a8eb-1bd5-4438-965f-d5f39537535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a402a8eb-1bd5-4438-965f-d5f39537535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be5419c-9ab0-4563-90fb-8b1a3b44124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be5419c-9ab0-4563-90fb-8b1a3b44124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e3e864e1-adcb-4a80-b5c4-1be140538902', 'volume_name': 'volume-e3e864e1-adcb-4a80-b5c4-1be140538902', 'volume_size': 2, 'snapshot_id': 'f39515ab-c194-4709-9f05-e43e5cfb8057'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b750f5b-c014-49b7-9ee2-96fe682d257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b750f5b-c014-49b7-9ee2-96fe682d257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1360ae-3251-4430-9f32-348945da838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:42 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume e3e864e1-adcb-4a80-b5c4-1be140538902: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e3e864e1-adcb-4a80-b5c4-1be140538902', 'volume_size': 2, 'snapshot_id': 'f39515ab-c194-4709-9f05-e43e5cfb8057'}
Nov 03 08:11:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:43 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:11:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Flow 'volume_create_manager' (c2a8096e-b358-4c3f-a12e-4f2d63b7308d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6817fdd-2fc8-48df-8fa0-dad290523b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6817fdd-2fc8-48df-8fa0-dad290523b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-666788310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08160cc1-113f-4143-a12b-ef0fbb881488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7744298ac149959e07fbb33fc97fe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:44Z,use_quota=True,user_id='0729e80e8dae4b77a7f902394a1a5b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bca602b-4b24-401f-a70c-77f48e8e2ff0),volume_type_id=7bca602b-4b24-401f-a70c-77f48e8e2ff0)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91eaa1af-e869-4898-aafb-bcccfdd04515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91eaa1af-e869-4898-aafb-bcccfdd04515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965824b3-9bc3-42bb-9d4e-8c89547efb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965824b3-9bc3-42bb-9d4e-8c89547efb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08160cc1-113f-4143-a12b-ef0fbb881488', 'volume_name': 'volume-08160cc1-113f-4143-a12b-ef0fbb881488', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a4b46c-626f-46cd-b2b9-da00d1ef441f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a4b46c-626f-46cd-b2b9-da00d1ef441f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff2b354-b85b-45ca-b157-9ac72fa7371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:44 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Volume 08160cc1-113f-4143-a12b-ef0fbb881488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08160cc1-113f-4143-a12b-ef0fbb881488', 'volume_size': 1}
Nov 03 08:11:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-ee1cfb79-a28d-42f3-a099-e0ef87ed55c9 req-27f740bb-14fd-4b41-b5f7-10914a1ffb8b tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:49 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" returned: 0 in 7.059s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:11:49 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Converted 1024.00 MB image at 145.04 MB/s
Nov 03 08:11:49 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14 is being set with open permissions: ugo+rw
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:49 devstack sudo[101166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14
Nov 03 08:11:49 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:49 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" returned: 0 in 0.240s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" released by "_copy_volume_from_snapshot" :: held 8.326s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-c8924b49-a7f4-49ab-9d9f-14a044b0f61e-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" released by "_create_volume_from_snapshot" :: held 8.410s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.441s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.626s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-f39515ab-c194-4709-9f05-e43e5cfb8057-e3e864e1-adcb-4a80-b5c4-1be140538902" by "_create_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-f39515ab-c194-4709-9f05-e43e5cfb8057-e3e864e1-adcb-4a80-b5c4-1be140538902" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Creating volume e3e864e1-adcb-4a80-b5c4-1be140538902 from snapshot f39515ab-c194-4709-9f05-e43e5cfb8057 {{(pid=86851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-e3e864e1-adcb-4a80-b5c4-1be140538902" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c8cd2d-597c-4169-800d-16a62b9b3829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14', 'volume_size': 1, 'snapshot_id': 'c8924b49-a7f4-49ab-9d9f-14a044b0f61e'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b385cb-63c3-49c4-a859-fdab96e4d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-e3e864e1-adcb-4a80-b5c4-1be140538902" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] snapshot: f39515ab-c194-4709-9f05-e43e5cfb8057, volume: e3e864e1-adcb-4a80-b5c4-1be140538902,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:11:49 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Volume volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14 (25931b25-1f33-4510-aa9e-0ab9ffe0eb14): created successfully
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b385cb-63c3-49c4-a859-fdab96e4d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Flow 'volume_create_manager' (89c9473e-8b26-4527-a2ae-706d44f60c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fb5074-3967-45a9-9cc5-d831f1820f12]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:49 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2d5984b1-a909-4132-bbdd-3363195b77af tempest-VolumeDependencyTests-233692846 None] Created volume successfully.
Nov 03 08:11:49 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057
Nov 03 08:11:49 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:50 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057" returned: 0 in 0.356s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7782225d-7e72-4ab5-8e31-7772f07cc753(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b065831-7f44-4589-bcec-d4757974505a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:50 devstack sudo[101174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753
Nov 03 08:11:50 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:50 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753" returned: 0 in 0.351s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902 not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:50 devstack sudo[101179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902
Nov 03 08:11:50 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Acquiring lock "cinder-c8924b49-a7f4-49ab-9d9f-14a044b0f61e-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Lock "cinder-c8924b49-a7f4-49ab-9d9f-14a044b0f61e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Acquiring lock "cinder-quobyte-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Acquiring lock "cinder-quobyte-c8924b49-a7f4-49ab-9d9f-14a044b0f61e" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-c8924b49-a7f4-49ab-9d9f-14a044b0f61e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Deleting offline snapshot c8924b49-a7f4-49ab-9d9f-14a044b0f61e of volume d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] snapshot_file for this snap is: volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2048a2-4a44-4524-a382-dd462e6f585a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:50 devstack sudo[101184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e
Nov 03 08:11:50 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:51 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e" returned: 0 in 0.473s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:11:51 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b645c6a-9bc0-4e23-a4a0-5967e5cb308f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:51 devstack sudo[101197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324
Nov 03 08:11:51 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:51 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" returned: 0 in 0.737s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:52 devstack sudo[101203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e
Nov 03 08:11:52 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:52 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e" returned: 0 in 0.631s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:52 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e
Nov 03 08:11:52 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:52 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324.c8924b49-a7f4-49ab-9d9f-14a044b0f61e" returned: 0 in 0.353s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-c8924b49-a7f4-49ab-9d9f-14a044b0f61e" released by "_delete_snapshot" :: held 2.370s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" released by "delete_snapshot" :: held 2.406s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:53 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Created reservations ['49a01d1a-b8f6-4943-bc6a-45818e312718', 'c244918a-5a5a-49f4-a686-88f61aa4d4a9', 'e59f1e1f-ff06-44e8-8221-4cab5293efb3', '34011815-78c0-4e72-931b-746f088ec67a'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:11:53 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Delete snapshot completed successfully.
Nov 03 08:11:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-dacbd0cf-0f7b-403b-b588-9d24dbf8bfd4 tempest-VolumeDependencyTests-233692846 None] Lock "cinder-c8924b49-a7f4-49ab-9d9f-14a044b0f61e-delete_snapshot" released by "delete_snapshot" :: held 2.697s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Acquiring lock "cinder-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Lock "cinder-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Acquiring lock "cinder-quobyte-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:54 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e93be9-001c-4790-9411-835f1879dd1b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:54 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324
Nov 03 08:11:54 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:54 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" returned: 0 in 0.595s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:54 devstack sudo[101217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324
Nov 03 08:11:54 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:55 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" returned: 0 in 0.375s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324" released by "delete_volume" :: held 1.114s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Created reservations ['bdd862db-cff6-4351-9388-9b748eda9330', '2cf1f0a7-a057-4f40-b55c-be92d16aa796', '5a400d1b-444d-4e78-93aa-bcc676af2335', '50ac1923-1f22-4747-95c3-a3cade986347'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:55 devstack sudo[101220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:11:55 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:55 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.316s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:11:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Deleted volume successfully.
Nov 03 08:11:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-67e37ece-61b1-4df5-b291-40a0e97b6a7b tempest-VolumeDependencyTests-233692846 None] Lock "cinder-d6b6f9f3-e74f-47ad-a4e1-45f49f4cc324-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Acquiring lock "cinder-25931b25-1f33-4510-aa9e-0ab9ffe0eb14-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Lock "cinder-25931b25-1f33-4510-aa9e-0ab9ffe0eb14-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Acquiring lock "cinder-quobyte-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:56 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7db065-563e-49e3-b713-447fca9dd607]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:56 devstack sudo[101223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14
Nov 03 08:11:56 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:56 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" returned: 0 in 0.514s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:56 devstack sudo[101229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14
Nov 03 08:11:56 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:57 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" returned: 0 in 0.403s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Lock "cinder-quobyte-25931b25-1f33-4510-aa9e-0ab9ffe0eb14" released by "delete_volume" :: held 1.011s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=99,cinder:SELECT=96,cinder:INSERT=33,cinder:DELETE=7 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=94,cinder:SELECT=104,cinder:INSERT=29,cinder:DELETE=9 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Created reservations ['c8fe6f88-f08a-4982-94fb-8bee28c2c20d', '177df70a-e906-467b-b7e7-4a2f17e0a6bf', '34b72f5a-97a8-4de1-8f43-921ff8a57c20', '01cfe4ea-2353-482f-9aa5-fe106d28cae9'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:11:57 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902" returned: 0 in 7.023s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:11:57 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Converted 1024.00 MB image at 145.79 MB/s
Nov 03 08:11:57 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902 is being set with open permissions: ugo+rw
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:57 devstack sudo[101232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902
Nov 03 08:11:57 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:57 devstack sudo[101234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:11:57 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:57 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902" returned: 0 in 0.268s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-e3e864e1-adcb-4a80-b5c4-1be140538902" released by "_copy_volume_from_snapshot" :: held 8.092s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:57 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.239s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:11:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Deleted volume successfully.
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0636886c-0031-41db-9954-6f4ced82cf4d tempest-VolumeDependencyTests-233692846 None] Lock "cinder-25931b25-1f33-4510-aa9e-0ab9ffe0eb14-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-f39515ab-c194-4709-9f05-e43e5cfb8057-e3e864e1-adcb-4a80-b5c4-1be140538902" released by "_create_volume_from_snapshot" :: held 8.192s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.212s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.754s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-666788310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08160cc1-113f-4143-a12b-ef0fbb881488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7744298ac149959e07fbb33fc97fe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:11:44Z,use_quota=True,user_id='0729e80e8dae4b77a7f902394a1a5b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bca602b-4b24-401f-a70c-77f48e8e2ff0),volume_type_id=7bca602b-4b24-401f-a70c-77f48e8e2ff0)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Creating volume 08160cc1-113f-4143-a12b-ef0fbb881488 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:11:57 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:57 devstack sudo[101238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488 1073741824
Nov 03 08:11:57 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1360ae-3251-4430-9f32-348945da838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e864e1-adcb-4a80-b5c4-1be140538902', 'volume_size': 2, 'snapshot_id': 'f39515ab-c194-4709-9f05-e43e5cfb8057'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ce6210-aaa7-4728-bb1b-eaabe4d25a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:57 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume volume-e3e864e1-adcb-4a80-b5c4-1be140538902 (e3e864e1-adcb-4a80-b5c4-1be140538902): created successfully
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ce6210-aaa7-4728-bb1b-eaabe4d25a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Flow 'volume_create_manager' (a9fc67ab-4c3f-4472-b2bb-87dc17cbc26b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-372aa1ec-c2ff-4bda-bf06-67acf2cc26a6 tempest-VolumesSnapshotTestJSON-1805349623 None] Created volume successfully.
Nov 03 08:11:58 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488 1073741824" returned: 0 in 0.425s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:58 devstack sudo[101243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488
Nov 03 08:11:58 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:58 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488" returned: 0 in 0.244s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-ee1cfb79-a28d-42f3-a099-e0ef87ed55c9 req-27f740bb-14fd-4b41-b5f7-10914a1ffb8b tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.623s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-ee1cfb79-a28d-42f3-a099-e0ef87ed55c9 req-27f740bb-14fd-4b41-b5f7-10914a1ffb8b tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff2b354-b85b-45ca-b157-9ac72fa7371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08160cc1-113f-4143-a12b-ef0fbb881488', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa57cfab-be17-428d-ba25-ed5269c4acbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:11:58 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Volume volume-08160cc1-113f-4143-a12b-ef0fbb881488 (08160cc1-113f-4143-a12b-ef0fbb881488): created successfully
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa57cfab-be17-428d-ba25-ed5269c4acbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Flow 'volume_create_manager' (c2a8096e-b358-4c3f-a12e-4f2d63b7308d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:11:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ef3e0f5c-e240-434a-9002-19647b4f28fa tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Created volume successfully.
Nov 03 08:11:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-ee1cfb79-a28d-42f3-a099-e0ef87ed55c9 req-27f740bb-14fd-4b41-b5f7-10914a1ffb8b tempest-TestInstancesWithCinderVolumes-685174399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d287a77-c6dd-4b49-89f4-03505b74f0b5', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:11:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-ee1cfb79-a28d-42f3-a099-e0ef87ed55c9 req-27f740bb-14fd-4b41-b5f7-10914a1ffb8b tempest-TestInstancesWithCinderVolumes-685174399 None] attachment_update completed successfully.
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-e3e864e1-adcb-4a80-b5c4-1be140538902-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-e3e864e1-adcb-4a80-b5c4-1be140538902-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-e3e864e1-adcb-4a80-b5c4-1be140538902" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-e3e864e1-adcb-4a80-b5c4-1be140538902" acquired by "delete_volume" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[965ce3aa-02f2-40ea-be16-637ad29ede2a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:59 devstack sudo[101248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902
Nov 03 08:11:59 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cc4769dc-c27a-4b2a-a010-ce311141a9dc tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cc4769dc-c27a-4b2a-a010-ce311141a9dc tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cc4769dc-c27a-4b2a-a010-ce311141a9dc tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cc4769dc-c27a-4b2a-a010-ce311141a9dc tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cc4769dc-c27a-4b2a-a010-ce311141a9dc tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cc4769dc-c27a-4b2a-a010-ce311141a9dc tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:59 devstack sudo[101250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:11:59 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:59 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902" returned: 0 in 0.451s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:11:59 devstack sudo[101255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902
Nov 03 08:11:59 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:11:59 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cc4769dc-c27a-4b2a-a010-ce311141a9dc tempest-VolumeRetypeWithoutMigrationTest-484789919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:11:59 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-cc4769dc-c27a-4b2a-a010-ce311141a9dc tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:11:59 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-cc4769dc-c27a-4b2a-a010-ce311141a9dc tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Retype volume completed successfully.
Nov 03 08:12:00 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e3e864e1-adcb-4a80-b5c4-1be140538902" returned: 0 in 0.305s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-e3e864e1-adcb-4a80-b5c4-1be140538902" released by "delete_volume" :: held 0.823s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Created reservations ['1f590c76-f75e-44a4-8d3e-a8a011ba403b', '0ec7a863-a0ec-4d0b-a921-9a0f5712cb39', '11e07426-bca5-4f47-8f69-60f72aa03286', '34feb7f7-6978-435d-abf7-91516ab1ad14'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:00 devstack sudo[101263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:00 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-f39515ab-c194-4709-9f05-e43e5cfb8057-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-f39515ab-c194-4709-9f05-e43e5cfb8057-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-7782225d-7e72-4ab5-8e31-7772f07cc753" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-7782225d-7e72-4ab5-8e31-7772f07cc753" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-f39515ab-c194-4709-9f05-e43e5cfb8057" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-f39515ab-c194-4709-9f05-e43e5cfb8057" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Deleting offline snapshot f39515ab-c194-4709-9f05-e43e5cfb8057 of volume 7782225d-7e72-4ab5-8e31-7772f07cc753 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] snapshot_file for this snap is: volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:12:00 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6052564-4dc7-469f-9a9a-44ae2ec6f684]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.356s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:00 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Deleted volume successfully.
Nov 03 08:12:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8425a107-8fb8-4ff4-aa23-d6ef8b8d65e9 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-e3e864e1-adcb-4a80-b5c4-1be140538902-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:00 devstack sudo[101270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057
Nov 03 08:12:00 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:01 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057" returned: 0 in 0.511s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7782225d-7e72-4ab5-8e31-7772f07cc753(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1249a33-db7e-4357-b7e0-4a882abb2062]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Acquiring lock "cinder-08160cc1-113f-4143-a12b-ef0fbb881488-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:01 devstack sudo[101276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753
Nov 03 08:12:01 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "cinder-08160cc1-113f-4143-a12b-ef0fbb881488-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Acquiring lock "cinder-quobyte-08160cc1-113f-4143-a12b-ef0fbb881488" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "cinder-quobyte-08160cc1-113f-4143-a12b-ef0fbb881488" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e891ebd-7947-4207-a0a5-0d989bb042a2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-5e3b24fd-51fb-4056-8163-826f3c3fac73 req-e433ea1e-515d-4a57-af67-78780d547ad1 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-5e3b24fd-51fb-4056-8163-826f3c3fac73 req-e433ea1e-515d-4a57-af67-78780d547ad1 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-5e3b24fd-51fb-4056-8163-826f3c3fac73 req-e433ea1e-515d-4a57-af67-78780d547ad1 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-5e3b24fd-51fb-4056-8163-826f3c3fac73 req-e433ea1e-515d-4a57-af67-78780d547ad1 tempest-TestInstancesWithCinderVolumes-685174399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0dd53424-223f-4b91-8b69-604334b2591f', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:12:01 devstack sudo[101286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488
Nov 03 08:12:01 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-5e3b24fd-51fb-4056-8163-826f3c3fac73 req-e433ea1e-515d-4a57-af67-78780d547ad1 tempest-TestInstancesWithCinderVolumes-685174399 None] attachment_update completed successfully.
Nov 03 08:12:01 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753" returned: 0 in 0.619s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:01 devstack sudo[101293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057
Nov 03 08:12:01 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:01 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488" returned: 0 in 0.553s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:01 devstack sudo[101298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488
Nov 03 08:12:01 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:02 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057" returned: 0 in 0.497s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:02 devstack sudo[101304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057
Nov 03 08:12:02 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:02 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-08160cc1-113f-4143-a12b-ef0fbb881488" returned: 0 in 0.378s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "cinder-quobyte-08160cc1-113f-4143-a12b-ef0fbb881488" released by "delete_volume" :: held 1.002s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:02 devstack cinder-volume[86851]: WARNING cinder.quota [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:12:02 devstack cinder-volume[86851]: WARNING cinder.quota [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Created reservations ['2c3b856e-2f32-4c0b-99c1-012d153b3786', 'a39089c6-3add-41da-9fea-ee7cc18bb60f', '7e7b063d-4bc5-45ad-8ffe-e67a526f37ca', 'd20aa924-2c23-49e9-83fc-f9d01b54e9fe'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:02 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753.f39515ab-c194-4709-9f05-e43e5cfb8057" returned: 0 in 0.300s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:02 devstack sudo[101308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:02 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-f39515ab-c194-4709-9f05-e43e5cfb8057" released by "_delete_snapshot" :: held 2.095s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-7782225d-7e72-4ab5-8e31-7772f07cc753" released by "delete_snapshot" :: held 2.128s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Created reservations ['ae8743e2-3c24-4083-b212-55ccb4d34c25', '86ce99e3-b054-4452-b2f0-b1aff45dd11b', '819c5f33-bb69-437e-ae4a-ddd609c6e8ea', '13740124-82d1-4f1b-835b-da4ad2f6d644'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Delete snapshot completed successfully.
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0ffcb7f-a18d-4d2a-bcf5-ea86ba4c3bca tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-f39515ab-c194-4709-9f05-e43e5cfb8057-delete_snapshot" released by "delete_snapshot" :: held 2.277s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:02 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.270s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Deleted volume successfully.
Nov 03 08:12:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3161f516-e70d-4319-a361-4ddf9121c126 tempest-VolumeRetypeWithoutMigrationTest-484789919 None] Lock "cinder-08160cc1-113f-4143-a12b-ef0fbb881488-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:03 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:03 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:03 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.296s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-7782225d-7e72-4ab5-8e31-7772f07cc753-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-7782225d-7e72-4ab5-8e31-7772f07cc753-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-7782225d-7e72-4ab5-8e31-7772f07cc753" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-7782225d-7e72-4ab5-8e31-7772f07cc753" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1df753e-1f89-4b5a-a670-bd0f656443f4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:04 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753
Nov 03 08:12:04 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:04 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753" returned: 0 in 0.485s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:04 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753
Nov 03 08:12:04 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:04 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7782225d-7e72-4ab5-8e31-7772f07cc753" returned: 0 in 0.289s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-7782225d-7e72-4ab5-8e31-7772f07cc753" released by "delete_volume" :: held 0.873s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Created reservations ['e83b57c1-d7d1-427f-8a8a-f5c7e25f5e76', '40dbf57f-8843-44f3-8063-ed8cbc4d3d0c', 'bbecf51f-cbec-467a-8276-bc7ef81ab698', 'e5aeb6b1-0378-49e6-8b67-6cdbe950ada5'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:04 devstack sudo[101332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:04 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Flow 'volume_create_manager' (4eb4dc69-9186-4d76-90fd-d0126874a3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb5c71c-de7a-4dd3-a184-3e39af5376bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb5c71c-de7a-4dd3-a184-3e39af5376bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f24198-28bf-4a4e-9633-096e09214633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f694246ba54e421d96a6add2b1004882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:05Z,use_quota=True,user_id='5982898cef2f4683bbc608200630d6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310528bf-fd60-4145-bb39-dad7d3b53116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310528bf-fd60-4145-bb39-dad7d3b53116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd74d40-70c4-457f-8bc8-0b91f3fbae8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.image.glance [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Creating Keystone auth plugin from conf {{(pid=86851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 08:12:05 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.439s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:05 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Deleted volume successfully.
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b3762a7e-3266-4fa2-b367-9d0ee944c23e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-7782225d-7e72-4ab5-8e31-7772f07cc753-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Flow 'volume_create_manager' (81e25541-b3cd-46e7-a58d-d0f895a74d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a90c7f6-12b8-419c-9ce4-b7c8069f7f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a90c7f6-12b8-419c-9ce4-b7c8069f7f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1779620719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f688f5-6765-45b3-9c2d-d82ebb3b2689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8903091ff4923a95c00ad3fc0c3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:06Z,use_quota=True,user_id='27f04e5bb4ae4a1d8cdca377e0a9a1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1b2af1-3594-407c-8969-ac6ac56251ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1b2af1-3594-407c-8969-ac6ac56251ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c0365b-6243-473e-81d6-00a46546941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c0365b-6243-473e-81d6-00a46546941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f688f5-6765-45b3-9c2d-d82ebb3b2689', 'volume_name': 'volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56273618-dc42-4bd6-9460-75093f95897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56273618-dc42-4bd6-9460-75093f95897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431a422a-5e46-4227-afa3-f0095f2a5867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume d8f688f5-6765-45b3-9c2d-d82ebb3b2689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689', 'volume_size': 1}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1779620719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f688f5-6765-45b3-9c2d-d82ebb3b2689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8903091ff4923a95c00ad3fc0c3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:06Z,use_quota=True,user_id='27f04e5bb4ae4a1d8cdca377e0a9a1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Creating volume d8f688f5-6765-45b3-9c2d-d82ebb3b2689 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:05 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:05 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 1073741824
Nov 03 08:12:05 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd74d40-70c4-457f-8bc8-0b91f3fbae8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8f24198-28bf-4a4e-9633-096e09214633', 'volume_name': 'volume-e8f24198-28bf-4a4e-9633-096e09214633', 'volume_size': 1, 'image_id': 'd6119958-56d6-44f3-8060-86c9dc67293f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6119958-56d6-44f3-8060-86c9dc67293f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5fb4ee571a238927e1faf949df30ec2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f694246ba54e421d96a6add2b1004882', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5aac27c429317765606da0105a24a1260f11a3bab9118d0446172a8c8ccc827a5795da4639e75662d659bedbfffc5fc32069ef29b32eed93bc71ebcd6dcee224', 'id': 'd6119958-56d6-44f3-8060-86c9dc67293f', 'created_at': datetime.datetime(2026, 11, 3, 7, 12, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 12, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6119958-56d6-44f3-8060-86c9dc67293f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f8bb050>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fe1478-73f5-4742-b74f-7d73646723e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fe1478-73f5-4742-b74f-7d73646723e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f670f1-3ce3-4191-a23c-28ecda9a2361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Volume e8f24198-28bf-4a4e-9633-096e09214633: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8f24198-28bf-4a4e-9633-096e09214633', 'volume_size': 1, 'image_id': 'd6119958-56d6-44f3-8060-86c9dc67293f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6119958-56d6-44f3-8060-86c9dc67293f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5fb4ee571a238927e1faf949df30ec2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f694246ba54e421d96a6add2b1004882', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5aac27c429317765606da0105a24a1260f11a3bab9118d0446172a8c8ccc827a5795da4639e75662d659bedbfffc5fc32069ef29b32eed93bc71ebcd6dcee224', 'id': 'd6119958-56d6-44f3-8060-86c9dc67293f', 'created_at': datetime.datetime(2026, 11, 3, 7, 12, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 12, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6119958-56d6-44f3-8060-86c9dc67293f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f8bb050>}
Nov 03 08:12:05 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Trying to clone e8f24198-28bf-4a4e-9633-096e09214633 from image d6119958-56d6-44f3-8060-86c9dc67293f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6119958-56d6-44f3-8060-86c9dc67293f', 'metadata': {}}]). {{(pid=86851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 08:12:06 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ea27a3-160a-49ce-a09c-fd3d31aec267]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:06 devstack sudo[101343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD
Nov 03 08:12:06 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:06 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 1073741824" returned: 0 in 0.637s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:06 devstack sudo[101354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689
Nov 03 08:12:06 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:06 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:06 devstack sudo[101360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD
Nov 03 08:12:06 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:06 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" returned: 0 in 0.293s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431a422a-5e46-4227-afa3-f0095f2a5867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37812550-cff8-4783-9a43-c441c6ede3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:06 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 (d8f688f5-6765-45b3-9c2d-d82ebb3b2689): created successfully
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37812550-cff8-4783-9a43-c441c6ede3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Flow 'volume_create_manager' (81e25541-b3cd-46e7-a58d-d0f895a74d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-58075097-8edb-4674-8d3e-b840cb8e92c3 tempest-VolumesSnapshotTestJSON-1805349623 None] Created volume successfully.
Nov 03 08:12:07 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Temporary image d6119958-56d6-44f3-8060-86c9dc67293f is fetched for user 5982898cef2f4683bbc608200630d6cf. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dff403f-1326-4b7e-9e3c-c9522a84e94f]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:07 devstack sudo[101372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD
Nov 03 08:12:07 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:07 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:07 devstack sudo[101380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD
Nov 03 08:12:07 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:07 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f24198-28bf-4a4e-9633-096e09214633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f694246ba54e421d96a6add2b1004882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:05Z,use_quota=True,user_id='5982898cef2f4683bbc608200630d6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Creating volume e8f24198-28bf-4a4e-9633-096e09214633 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:07 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:07 devstack sudo[101385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 1073741824
Nov 03 08:12:07 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-58af1e57-a70a-4737-845d-91469618b6ae req-81b3df5a-4c1a-44da-8d4d-dee85513195b tempest-TestInstancesWithCinderVolumes-685174399 None] Terminate volume connection completed successfully.
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-58af1e57-a70a-4737-845d-91469618b6ae req-81b3df5a-4c1a-44da-8d4d-dee85513195b tempest-TestInstancesWithCinderVolumes-685174399 None] Deleting attachment 7d287a77-c6dd-4b49-89f4-03505b74f0b5. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:12:08 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 1073741824" returned: 0 in 0.632s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:08 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633
Nov 03 08:12:08 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:08 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.716s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Creating offline snapshot ffa7d5e1-5510-4521-b43f-2f456ed52478 of volume d8f688f5-6765-45b3-9c2d-d82ebb3b2689 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "cinder-c6ba2c37-cbda-4dbc-a74b-f46338adeef5-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d4f9a9-0a32-4dcb-a663-62f0dc56f54d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-c6ba2c37-cbda-4dbc-a74b-f46338adeef5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Attempting download of d6119958-56d6-44f3-8060-86c9dc67293f ((None, [{'url': 'file:///opt/stack/data/glance/images/d6119958-56d6-44f3-8060-86c9dc67293f', 'metadata': {}}])) to volume e8f24198-28bf-4a4e-9633-096e09214633. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "cinder-quobyte-c6ba2c37-cbda-4dbc-a74b-f46338adeef5" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b25caf-3afd-4974-9a49-1ecd7cadfd19]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6119958-56d6-44f3-8060-86c9dc67293f_xpmddfhx {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-quobyte-c6ba2c37-cbda-4dbc-a74b-f46338adeef5" acquired by "delete_volume" :: waited 0.041s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:09 devstack sudo[101398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689
Nov 03 08:12:09 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05814dd-b10f-4922-b750-1cc47a284434]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:09 devstack sudo[101401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6119958-56d6-44f3-8060-86c9dc67293f_xpmddfhx
Nov 03 08:12:09 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:09 devstack sudo[101403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5
Nov 03 08:12:09 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:09 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6119958-56d6-44f3-8060-86c9dc67293f_xpmddfhx" returned: 0 in 0.467s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6119958-56d6-44f3-8060-86c9dc67293f_xpmddfhx {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:09 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" returned: 0 in 0.618s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:09 devstack sudo[101413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 1G
Nov 03 08:12:09 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:09 devstack sudo[101412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6119958-56d6-44f3-8060-86c9dc67293f_xpmddfhx
Nov 03 08:12:09 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:09 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5" returned: 0 in 0.576s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:09 devstack sudo[101419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5
Nov 03 08:12:09 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:09 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6119958-56d6-44f3-8060-86c9dc67293f_xpmddfhx" returned: 1 in 0.398s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6119958-56d6-44f3-8060-86c9dc67293f_xpmddfhx' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cafa4d-c042-4673-a47c-3adb8ccffe5a]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:09 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c6ba2c37-cbda-4dbc-a74b-f46338adeef5" returned: 0 in 0.340s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-quobyte-c6ba2c37-cbda-4dbc-a74b-f46338adeef5" released by "delete_volume" :: held 1.016s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:10 devstack sudo[101425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD
Nov 03 08:12:10 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:10 devstack cinder-volume[86851]: WARNING cinder.quota [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-204630992-594447079 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-204630992-594447079, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:12:10 devstack cinder-volume[86851]: WARNING cinder.quota [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-204630992-594447079 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-204630992-594447079, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Created reservations ['92e9dd5b-bdb6-4a34-9cb4-fb672a603a98', 'ae263b26-b450-4513-9611-7c8776a5a655', '02bd557a-e63c-4f24-91c0-3fd20cd19e9a', '2cdbd2c5-4bb5-4193-9960-a77391a752f0'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:10 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 1G" returned: 0 in 0.644s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:10 devstack sudo[101430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478
Nov 03 08:12:10 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:10 devstack sudo[101432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:10 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:10 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:10 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478" returned: 0 in 0.416s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:10 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 is being set with open permissions: ugo+rw
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:10 devstack sudo[101438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD
Nov 03 08:12:10 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:10 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.372s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:10 devstack sudo[101441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478
Nov 03 08:12:10 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Deleted volume successfully.
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-054e7095-923f-4c67-9b19-67ff4b6f4473 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-c6ba2c37-cbda-4dbc-a74b-f46338adeef5-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:10 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD" returned: 1 in 0.445s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] d6119958-56d6-44f3-8060-86c9dc67293f was raw, converting to qcow2 {{(pid=86851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:10 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478" returned: 0 in 0.339s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:10 devstack sudo[101448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633
Nov 03 08:12:10 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:10 devstack sudo[101450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.info
Nov 03 08:12:10 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:11 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.info" returned: 0 in 0.331s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:11 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.info is being set with open permissions: ugo+rw
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:11 devstack sudo[101457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.info
Nov 03 08:12:11 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:11 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633" returned: 0 in 0.617s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6119958-56d6-44f3-8060-86c9dc67293f_rxxqzi0fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:12:11 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:11 devstack sudo[101463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 1G
Nov 03 08:12:11 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:11 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.info" returned: 0 in 0.331s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.816s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0ccd2a0b-8447-492a-b661-37191e0a87ad tempest-VolumesSnapshotTestJSON-1805349623 None] Create snapshot completed successfully
Nov 03 08:12:11 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 1G" returned: 0 in 0.412s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Downloaded image d6119958-56d6-44f3-8060-86c9dc67293f ((None, [{'url': 'file:///opt/stack/data/glance/images/d6119958-56d6-44f3-8060-86c9dc67293f', 'metadata': {}}])) to volume e8f24198-28bf-4a4e-9633-096e09214633 successfully. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Temporary image d6119958-56d6-44f3-8060-86c9dc67293f for user 5982898cef2f4683bbc608200630d6cf is deleted. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Marking volume e8f24198-28bf-4a4e-9633-096e09214633 as bootable. {{(pid=86851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Copying metadata from image d6119958-56d6-44f3-8060-86c9dc67293f to e8f24198-28bf-4a4e-9633-096e09214633. {{(pid=86851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Creating volume glance metadata for volume e8f24198-28bf-4a4e-9633-096e09214633 backed by image d6119958-56d6-44f3-8060-86c9dc67293f with: {'image_id': 'd6119958-56d6-44f3-8060-86c9dc67293f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a5fb4ee571a238927e1faf949df30ec2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f670f1-3ce3-4191-a23c-28ecda9a2361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f24198-28bf-4a4e-9633-096e09214633', 'volume_size': 1, 'image_id': 'd6119958-56d6-44f3-8060-86c9dc67293f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6119958-56d6-44f3-8060-86c9dc67293f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5fb4ee571a238927e1faf949df30ec2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f694246ba54e421d96a6add2b1004882', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5aac27c429317765606da0105a24a1260f11a3bab9118d0446172a8c8ccc827a5795da4639e75662d659bedbfffc5fc32069ef29b32eed93bc71ebcd6dcee224', 'id': 'd6119958-56d6-44f3-8060-86c9dc67293f', 'created_at': datetime.datetime(2026, 11, 3, 7, 12, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 12, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6119958-56d6-44f3-8060-86c9dc67293f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f8bb050>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188c6278-5a2a-45b5-9664-630ea6dc5894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:12 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Volume volume-e8f24198-28bf-4a4e-9633-096e09214633 (e8f24198-28bf-4a4e-9633-096e09214633): created successfully
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188c6278-5a2a-45b5-9664-630ea6dc5894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Flow 'volume_create_manager' (4eb4dc69-9186-4d76-90fd-d0126874a3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9b84c203-6565-4e67-bb50-4857f09e5674 tempest-VolumeImageDependencyTests-1671454689 None] Created volume successfully.
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Flow 'volume_create_manager' (1f257ba4-d966-4228-8f64-9b53b7796761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f271720b-941d-4fc7-ba3a-aa791fe9da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f271720b-941d-4fc7-ba3a-aa791fe9da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1697315672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b024e18ce2354934b38b620fffafa158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:12Z,use_quota=True,user_id='db0e32fdc93a4b389c022b95835671e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cd9bb0-d734-4563-9d10-c990d8c44a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cd9bb0-d734-4563-9d10-c990d8c44a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72be9235-35a2-463e-9f14-3310533ee35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72be9235-35a2-463e-9f14-3310533ee35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8', 'volume_name': 'volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0601967c-7bba-4086-a3ed-d8c97fdc1ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0601967c-7bba-4086-a3ed-d8c97fdc1ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d500e5e6-8dee-4791-9450-77a40ad8c796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:12 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Volume 7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8', 'volume_size': 1}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1697315672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b024e18ce2354934b38b620fffafa158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:12Z,use_quota=True,user_id='db0e32fdc93a4b389c022b95835671e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Creating volume 7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:12 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:12 devstack sudo[101484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8 1073741824
Nov 03 08:12:12 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Acquiring lock "cinder-e8f24198-28bf-4a4e-9633-096e09214633-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Lock "cinder-e8f24198-28bf-4a4e-9633-096e09214633-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:12 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:12 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8 1073741824" returned: 0 in 0.620s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Flow 'volume_create_manager' (6640ff36-0d51-4951-a56d-8124de08da6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80734ec-da42-4e85-9bad-11e69b998c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Acquiring lock "cinder-quobyte-e8f24198-28bf-4a4e-9633-096e09214633" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80734ec-da42-4e85-9bad-11e69b998c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1375234462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6a469e-d208-4b02-a462-8ba5a856707e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c8903091ff4923a95c00ad3fc0c3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ffa7d5e1-5510-4521-b43f-2f456ed52478,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:13Z,use_quota=True,user_id='27f04e5bb4ae4a1d8cdca377e0a9a1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb81696-07f1-4166-b930-e2470faf7e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb81696-07f1-4166-b930-e2470faf7e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3893f634-c824-4da6-8937-d7150b25efea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3893f634-c824-4da6-8937-d7150b25efea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd6a469e-d208-4b02-a462-8ba5a856707e', 'volume_name': 'volume-cd6a469e-d208-4b02-a462-8ba5a856707e', 'volume_size': 1, 'snapshot_id': 'ffa7d5e1-5510-4521-b43f-2f456ed52478'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76ad16a-aa09-43a8-808e-87d43b4b4352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76ad16a-aa09-43a8-808e-87d43b4b4352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b096e47b-4f06-4d45-a370-bf4ac4f30732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume cd6a469e-d208-4b02-a462-8ba5a856707e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd6a469e-d208-4b02-a462-8ba5a856707e', 'volume_size': 1, 'snapshot_id': 'ffa7d5e1-5510-4521-b43f-2f456ed52478'}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Lock "cinder-quobyte-e8f24198-28bf-4a4e-9633-096e09214633" acquired by "delete_volume" :: waited 0.062s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cb9dde-de0b-4ffe-9461-276e0b59feb1]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:13 devstack sudo[101491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8
Nov 03 08:12:13 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:13 devstack sudo[101492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633
Nov 03 08:12:13 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-2189c15d-07ba-4301-87df-9b7004110db8 req-7bbe9316-3153-435e-8571-3c9866295978 tempest-TestInstancesWithCinderVolumes-685174399 None] Terminate volume connection completed successfully.
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-2189c15d-07ba-4301-87df-9b7004110db8 req-7bbe9316-3153-435e-8571-3c9866295978 tempest-TestInstancesWithCinderVolumes-685174399 None] Deleting attachment 0dd53424-223f-4b91-8b69-604334b2591f. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:12:13 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8" returned: 0 in 0.277s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.305s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-ffa7d5e1-5510-4521-b43f-2f456ed52478-cd6a469e-d208-4b02-a462-8ba5a856707e" by "_create_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d500e5e6-8dee-4791-9450-77a40ad8c796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5102aaf-ecbc-4658-a16d-0fae3fa5f126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Volume volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8 (7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8): created successfully
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5102aaf-ecbc-4658-a16d-0fae3fa5f126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Flow 'volume_create_manager' (1f257ba4-d966-4228-8f64-9b53b7796761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-ffa7d5e1-5510-4521-b43f-2f456ed52478-cd6a469e-d208-4b02-a462-8ba5a856707e" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Creating volume cd6a469e-d208-4b02-a462-8ba5a856707e from snapshot ffa7d5e1-5510-4521-b43f-2f456ed52478 {{(pid=86851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-cd6a469e-d208-4b02-a462-8ba5a856707e" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c8709e12-65df-4565-8378-1b6cd7b55138 tempest-AbsoluteLimitsTests-1767622754 None] Created volume successfully.
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-cd6a469e-d208-4b02-a462-8ba5a856707e" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] snapshot: ffa7d5e1-5510-4521-b43f-2f456ed52478, volume: cd6a469e-d208-4b02-a462-8ba5a856707e,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:13 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0913e762-5e30-4027-9a96-fd6ddea3eee5]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633" returned: 0 in 0.444s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:13 devstack sudo[101502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633
Nov 03 08:12:13 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:13 devstack sudo[101501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478
Nov 03 08:12:13 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:13 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e8f24198-28bf-4a4e-9633-096e09214633" returned: 0 in 0.255s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Lock "cinder-quobyte-e8f24198-28bf-4a4e-9633-096e09214633" released by "delete_volume" :: held 0.761s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:13 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Created reservations ['2f52ad7f-6af2-4897-9a36-6141c59a1eb8', '8e79d126-63e1-459d-bb8a-5c00128c0ffc', '5721ddf9-46c0-4a0f-9b30-9b42dcb5fe97', 'f65f2523-1fd8-4549-9ce5-a548bbdf843b'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:14 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478" returned: 0 in 0.396s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ff4104-c7ab-4e11-acf9-25d65896ed28]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:14 devstack sudo[101510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:14 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:14 devstack sudo[101511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689
Nov 03 08:12:14 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "cinder-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "cinder-quobyte-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-quobyte-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee" acquired by "delete_volume" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:14 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.360s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f348d2cc-c835-4e2b-9c25-783d80ce86c8]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:14 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Deleted volume successfully.
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-99e8fe6c-f182-41ff-8f9c-2185e3c4400e tempest-VolumeImageDependencyTests-1671454689 None] Lock "cinder-e8f24198-28bf-4a4e-9633-096e09214633-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:14 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" returned: 0 in 0.551s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:14 devstack sudo[101515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee
Nov 03 08:12:14 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:14 devstack sudo[101519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e
Nov 03 08:12:14 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:14 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee" returned: 0 in 0.544s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:14 devstack sudo[101529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee
Nov 03 08:12:15 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Acquiring lock "cinder-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Lock "cinder-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Acquiring lock "cinder-quobyte-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Lock "cinder-quobyte-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50bb870-fd4e-4c34-b66d-500e6bd3918c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:15 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee" returned: 0 in 0.475s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:15 devstack sudo[101532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8
Nov 03 08:12:15 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-quobyte-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee" released by "delete_volume" :: held 1.119s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:15 devstack cinder-volume[86851]: WARNING cinder.quota [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1734166045-1220392626 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1734166045-1220392626, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:12:15 devstack cinder-volume[86851]: WARNING cinder.quota [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1734166045-1220392626 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1734166045-1220392626, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Created reservations ['7dd9e717-5847-4b6d-97f7-db8d47cad14b', '4014fbb6-ac7d-45f2-bc62-77305d6ea48c', '7dfc0c98-c3a3-4091-b472-c78004cef774', 'c6e07c6f-6d74-4c65-b22c-33af1306f4e7'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:15 devstack sudo[101544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:15 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:16 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8" returned: 0 in 0.826s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:16 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8
Nov 03 08:12:16 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:16 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.476s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:16 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Deleted volume successfully.
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-59bfb6f3-3b25-4d73-bc76-9633a7f04585 tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-e576f2dd-0ea2-4aa3-a866-bdc6175e02ee-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:16 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8" returned: 0 in 0.463s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Lock "cinder-quobyte-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8" released by "delete_volume" :: held 1.367s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Created reservations ['ef924f4c-b47a-4659-bc6d-c7d851fdcefe', 'd53e3e14-77dc-4bab-8a19-4e8567bb5a58', '668a8349-03c4-45e7-a399-dddaf80c3a4e', 'ef084a26-3226-49b7-8eda-be108cc4a9ba'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:17 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:17 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:17 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.412s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:17 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Deleted volume successfully.
Nov 03 08:12:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0a8c3be-5328-4d6f-9938-447b4a33c3df tempest-AbsoluteLimitsTests-1767622754 None] Lock "cinder-7a2d5dd5-7dc6-4618-bcd8-7dca561e6ff8-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Flow 'volume_create_manager' (94a11a07-c1cd-45ae-8465-8a2e3304fb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b4d99f-0bf0-46ab-aa70-d56616c35169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b4d99f-0bf0-46ab-aa70-d56616c35169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c819c8f-6084-4761-b74d-78c96bc5ce46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b86b04b54e947a985cc1eb2ea8d75ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:23Z,use_quota=True,user_id='e0983b63ab1049769f5163db50d3569c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ea6746-7bde-43e1-a2e7-6ae6db15ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ea6746-7bde-43e1-a2e7-6ae6db15ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55895f98-8df4-4d6c-bf60-1ee5c49ea355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55895f98-8df4-4d6c-bf60-1ee5c49ea355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c819c8f-6084-4761-b74d-78c96bc5ce46', 'volume_name': 'volume-2c819c8f-6084-4761-b74d-78c96bc5ce46', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6420d469-caa1-468c-a2ad-74ebd9736a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6420d469-caa1-468c-a2ad-74ebd9736a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5ff677-89eb-4552-9931-6f3943acb27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:23 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Volume 2c819c8f-6084-4761-b74d-78c96bc5ce46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c819c8f-6084-4761-b74d-78c96bc5ce46', 'volume_size': 1}
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-9428e1b6-3f31-47c4-a8aa-a8a5d1d81f07 req-0d94f18d-10f1-451f-8a8b-e4a440cd056b tempest-TestInstancesWithCinderVolumes-685174399 None] Terminate volume connection completed successfully.
Nov 03 08:12:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-9428e1b6-3f31-47c4-a8aa-a8a5d1d81f07 req-0d94f18d-10f1-451f-8a8b-e4a440cd056b tempest-TestInstancesWithCinderVolumes-685174399 None] Deleting attachment c0b8d44b-241b-4337-ac58-a801c25a8768. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:12:25 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e" returned: 0 in 10.656s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689, size 1024.00 MB, duration 10.66 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:12:25 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Converted 1024.00 MB image at 96.08 MB/s
Nov 03 08:12:25 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e is being set with open permissions: ugo+rw
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:25 devstack sudo[101593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e
Nov 03 08:12:25 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:25 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "cinder-c5f57ee2-f9d3-451b-9cc0-06850884165c-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e" returned: 0 in 0.300s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-cd6a469e-d208-4b02-a462-8ba5a856707e" released by "_copy_volume_from_snapshot" :: held 12.022s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-c5f57ee2-f9d3-451b-9cc0-06850884165c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "cinder-quobyte-c5f57ee2-f9d3-451b-9cc0-06850884165c" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-ffa7d5e1-5510-4521-b43f-2f456ed52478-cd6a469e-d208-4b02-a462-8ba5a856707e" released by "_create_volume_from_snapshot" :: held 12.131s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.191s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.388s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c819c8f-6084-4761-b74d-78c96bc5ce46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b86b04b54e947a985cc1eb2ea8d75ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:23Z,use_quota=True,user_id='e0983b63ab1049769f5163db50d3569c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Creating volume 2c819c8f-6084-4761-b74d-78c96bc5ce46 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:25 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:25 devstack sudo[101596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46 1073741824
Nov 03 08:12:25 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-quobyte-c5f57ee2-f9d3-451b-9cc0-06850884165c" acquired by "delete_volume" :: waited 0.062s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b096e47b-4f06-4d45-a370-bf4ac4f30732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd6a469e-d208-4b02-a462-8ba5a856707e', 'volume_size': 1, 'snapshot_id': 'ffa7d5e1-5510-4521-b43f-2f456ed52478'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf99222-8799-41f7-83a1-874368f1a64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c1c67d-e0c7-4953-8146-663b7e9b0a8a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:25 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Volume volume-cd6a469e-d208-4b02-a462-8ba5a856707e (cd6a469e-d208-4b02-a462-8ba5a856707e): created successfully
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf99222-8799-41f7-83a1-874368f1a64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Flow 'volume_create_manager' (6640ff36-0d51-4951-a56d-8124de08da6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-647d115f-545a-43aa-9f22-b58a85ccf2a4 tempest-VolumesSnapshotTestJSON-1805349623 None] Created volume successfully.
Nov 03 08:12:25 devstack sudo[101598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c
Nov 03 08:12:25 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:26 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46 1073741824" returned: 0 in 0.511s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:26 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c" returned: 0 in 0.448s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:26 devstack sudo[101608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c
Nov 03 08:12:26 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:26 devstack sudo[101610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46
Nov 03 08:12:26 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:26 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c5f57ee2-f9d3-451b-9cc0-06850884165c" returned: 0 in 0.287s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:26 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-quobyte-c5f57ee2-f9d3-451b-9cc0-06850884165c" released by "delete_volume" :: held 0.802s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5ff677-89eb-4552-9931-6f3943acb27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c819c8f-6084-4761-b74d-78c96bc5ce46', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06a0b78-99de-4544-ab90-340620730369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:26 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Volume volume-2c819c8f-6084-4761-b74d-78c96bc5ce46 (2c819c8f-6084-4761-b74d-78c96bc5ce46): created successfully
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06a0b78-99de-4544-ab90-340620730369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Flow 'volume_create_manager' (94a11a07-c1cd-45ae-8465-8a2e3304fb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:26 devstack cinder-volume[86851]: WARNING cinder.quota [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2053899685-935366208 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2053899685-935366208, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:12:26 devstack cinder-volume[86851]: WARNING cinder.quota [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2053899685-935366208 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2053899685-935366208, it is now deprecated. Please use the default quota class for default quota.
Nov 03 08:12:26 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c468ccaf-1de6-4e94-834a-c6a6dbc7cada tempest-CinderUnicodeTest-963132091 None] Created volume successfully.
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-cd6a469e-d208-4b02-a462-8ba5a856707e-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Created reservations ['d622affb-f849-42db-9083-f40e16f94d57', '45f66dc9-5bfb-441f-a5ce-494203f2f136', 'bad99ac7-a387-44c5-9629-af3539c54d70', '4cf9542d-f77b-461d-a7c8-811cc9fc230c'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-cd6a469e-d208-4b02-a462-8ba5a856707e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-cd6a469e-d208-4b02-a462-8ba5a856707e" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-cd6a469e-d208-4b02-a462-8ba5a856707e" acquired by "delete_volume" :: waited 0.032s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08913da-776e-4675-8c97-9c1ede5d09bc]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:26 devstack sudo[101614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:26 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:26 devstack sudo[101616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e
Nov 03 08:12:26 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:27 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.317s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:27 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Deleted volume successfully.
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0ac495a2-ba35-423a-83da-9b77b8ecfdcc tempest-TestInstancesWithCinderVolumes-685174399 None] Lock "cinder-c5f57ee2-f9d3-451b-9cc0-06850884165c-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:27 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e" returned: 0 in 0.443s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:27 devstack sudo[101622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e
Nov 03 08:12:27 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:27 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-cd6a469e-d208-4b02-a462-8ba5a856707e" returned: 0 in 0.338s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-cd6a469e-d208-4b02-a462-8ba5a856707e" released by "delete_volume" :: held 0.875s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Created reservations ['a5cf2087-ef47-420f-95fb-2053a5732077', 'a6ecf865-1664-47f9-b188-f832e83a208e', '6f2e579a-0509-433e-9109-f542ee984243', 'a44aacbb-88be-4459-b23b-be2a32925576'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:27 devstack sudo[101625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:27 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-ffa7d5e1-5510-4521-b43f-2f456ed52478-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-ffa7d5e1-5510-4521-b43f-2f456ed52478-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Flow 'volume_create_manager' (f4da08ba-0811-458f-9a03-bb380a138f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0650dd3e-7575-479f-8a53-cceea130a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" acquired by "delete_snapshot" :: waited 0.136s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-ffa7d5e1-5510-4521-b43f-2f456ed52478" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0650dd3e-7575-479f-8a53-cceea130a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-631354673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c99e104-59a2-48c3-b6c3-cc243f680d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b86b04b54e947a985cc1eb2ea8d75ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:28Z,use_quota=True,user_id='e0983b63ab1049769f5163db50d3569c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9796ebe-5898-4463-be6e-0a397aa538f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9796ebe-5898-4463-be6e-0a397aa538f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abef40f-79da-4491-9da4-367a26641732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abef40f-79da-4491-9da4-367a26641732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c99e104-59a2-48c3-b6c3-cc243f680d2d', 'volume_name': 'volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d30c01d-13d2-4b16-86b1-44ac790e563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d30c01d-13d2-4b16-86b1-44ac790e563b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:28 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db041b10-9095-4773-8c44-593e86e190d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:28 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Volume 4c99e104-59a2-48c3-b6c3-cc243f680d2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d', 'volume_size': 1}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-631354673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c99e104-59a2-48c3-b6c3-cc243f680d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b86b04b54e947a985cc1eb2ea8d75ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:28Z,use_quota=True,user_id='e0983b63ab1049769f5163db50d3569c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Creating volume 4c99e104-59a2-48c3-b6c3-cc243f680d2d {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:28 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.604s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-ffa7d5e1-5510-4521-b43f-2f456ed52478" acquired by "_delete_snapshot" :: waited 0.126s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Deleting offline snapshot ffa7d5e1-5510-4521-b43f-2f456ed52478 of volume d8f688f5-6765-45b3-9c2d-d82ebb3b2689 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:12:28 devstack sudo[101628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d 1073741824
Nov 03 08:12:28 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] snapshot_file for this snap is: volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:12:28 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Deleted volume successfully.
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93fca1e-79e5-47bd-8e3c-174990cb73ea]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Flow 'volume_create_manager' (ea9b17e0-a3d4-4dcf-b791-cd0b071e1ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8440af6-b6fb-452b-8406-9440433144a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7c188f31-d298-46aa-a223-113d0fdcfade tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-cd6a469e-d208-4b02-a462-8ba5a856707e-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8440af6-b6fb-452b-8406-9440433144a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2002506520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe72ee3-06f4-4b10-b6a8-0010a98f3989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea172f8f522488ea392e98d0f3d1fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:28Z,use_quota=True,user_id='a31d628211e04c33b880e1df6cd95fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c03f128-9eff-4aaf-8451-d352c9e6b5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c03f128-9eff-4aaf-8451-d352c9e6b5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1866613d-594a-4cf2-b256-7b2eda6f57a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1866613d-594a-4cf2-b256-7b2eda6f57a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe72ee3-06f4-4b10-b6a8-0010a98f3989', 'volume_name': 'volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761c621d-e191-4ff3-a568-269d79c43533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761c621d-e191-4ff3-a568-269d79c43533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933ee978-fb5a-4f8d-918e-e202524a063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:28 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Volume 8fe72ee3-06f4-4b10-b6a8-0010a98f3989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989', 'volume_size': 1}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:28 devstack sudo[101630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478
Nov 03 08:12:28 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:28 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d 1073741824" returned: 0 in 0.481s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:28 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478" returned: 0 in 0.438s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:12:28 devstack sudo[101638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d
Nov 03 08:12:28 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc4962-151a-4d04-bf86-e44507567298]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:29 devstack sudo[101640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689
Nov 03 08:12:29 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:29 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d" returned: 0 in 0.288s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2002506520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe72ee3-06f4-4b10-b6a8-0010a98f3989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea172f8f522488ea392e98d0f3d1fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:28Z,use_quota=True,user_id='a31d628211e04c33b880e1df6cd95fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Creating volume 8fe72ee3-06f4-4b10-b6a8-0010a98f3989 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:29 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db041b10-9095-4773-8c44-593e86e190d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:29 devstack sudo[101643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989 1073741824
Nov 03 08:12:29 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae0a9ac-bb98-4c36-b947-c464d16bc246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:29 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Volume volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d (4c99e104-59a2-48c3-b6c3-cc243f680d2d): created successfully
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae0a9ac-bb98-4c36-b947-c464d16bc246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Flow 'volume_create_manager' (f4da08ba-0811-458f-9a03-bb380a138f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:29 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3f8a9499-07f9-4a06-a4f7-f2bc0bb5147f tempest-CinderUnicodeTest-963132091 None] Created volume successfully.
Nov 03 08:12:29 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" returned: 0 in 0.560s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:29 devstack sudo[101652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478
Nov 03 08:12:29 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:29 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989 1073741824" returned: 0 in 0.523s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:29 devstack sudo[101655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989
Nov 03 08:12:29 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:29 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478" returned: 0 in 0.410s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:29 devstack sudo[101660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478
Nov 03 08:12:29 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:29 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933ee978-fb5a-4f8d-918e-e202524a063d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d603f783-00cd-4aa5-8a84-9f6b0bab40b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:29 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Volume volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989 (8fe72ee3-06f4-4b10-b6a8-0010a98f3989): created successfully
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d603f783-00cd-4aa5-8a84-9f6b0bab40b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Flow 'volume_create_manager' (ea9b17e0-a3d4-4dcf-b791-cd0b071e1ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:30 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4c363897-b3e0-4160-8def-bed7ecd07e29 tempest-VolumesMetadataTest-1921080518 None] Created volume successfully.
Nov 03 08:12:30 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689.ffa7d5e1-5510-4521-b43f-2f456ed52478" returned: 0 in 0.341s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-ffa7d5e1-5510-4521-b43f-2f456ed52478" released by "_delete_snapshot" :: held 1.945s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" released by "delete_snapshot" :: held 2.085s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Creating offline snapshot d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 of volume 4c99e104-59a2-48c3-b6c3-cc243f680d2d {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a55a25-b1f3-4da7-81e7-89a38910375e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Created reservations ['22be51a7-6e9b-486f-a4d9-386296cf42f9', '94067fa7-84b6-478c-b35e-ba56956ebdea', '9433ccff-4830-432f-a5db-5200e06bd543', 'cad07038-2eae-4084-8e0e-1e4a8f28ce9c'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:30 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Delete snapshot completed successfully.
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1f4e7130-b978-488b-96e3-0146aa0d632b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-ffa7d5e1-5510-4521-b43f-2f456ed52478-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:30 devstack sudo[101664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d
Nov 03 08:12:30 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:30 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d" returned: 0 in 0.503s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:30 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 1G
Nov 03 08:12:30 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Acquiring lock "cinder-8fe72ee3-06f4-4b10-b6a8-0010a98f3989-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Lock "cinder-8fe72ee3-06f4-4b10-b6a8-0010a98f3989-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Acquiring lock "cinder-quobyte-8fe72ee3-06f4-4b10-b6a8-0010a98f3989" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Lock "cinder-quobyte-8fe72ee3-06f4-4b10-b6a8-0010a98f3989" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaf6b0e-0bd9-4821-b775-c2c193ef7282]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:31 devstack sudo[101674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989
Nov 03 08:12:31 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:31 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 1G" returned: 0 in 0.489s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:31 devstack sudo[101677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51
Nov 03 08:12:31 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-d8f688f5-6765-45b3-9c2d-d82ebb3b2689-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-d8f688f5-6765-45b3-9c2d-d82ebb3b2689-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb53a4-289b-4550-a60f-90d2769f6b3f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:31 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989" returned: 0 in 0.409s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:31 devstack sudo[101685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989
Nov 03 08:12:31 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:31 devstack sudo[101681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689
Nov 03 08:12:31 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:31 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51" returned: 0 in 0.366s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:31 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 is being set with open permissions: ugo+rw
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:31 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51
Nov 03 08:12:31 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:31 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-8fe72ee3-06f4-4b10-b6a8-0010a98f3989" returned: 0 in 0.385s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Lock "cinder-quobyte-8fe72ee3-06f4-4b10-b6a8-0010a98f3989" released by "delete_volume" :: held 0.852s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:32 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" returned: 0 in 0.516s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:32 devstack sudo[101696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689
Nov 03 08:12:32 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:32 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51" returned: 0 in 0.390s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Created reservations ['9023f73e-b51f-4e8d-86da-be8550c995c8', '0c06285c-4cb1-4f7f-a592-65ea6e06b33c', 'b0791eeb-ebb3-4f61-900f-2a43ddf9907d', '63cdafb4-0d72-43a8-82f0-d1a3d8c982a0'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:32 devstack sudo[101698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.info
Nov 03 08:12:32 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:32 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:32 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:32 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" returned: 0 in 0.360s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-d8f688f5-6765-45b3-9c2d-d82ebb3b2689" released by "delete_volume" :: held 0.954s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Created reservations ['ae8e3ede-05c6-4486-a43e-f5801af2563e', 'f0e198fd-3ed0-450b-b3d2-71b98f727119', 'c3a3bf02-b9c9-4722-b557-e8ba1c655e68', '73a2f02f-88f3-472d-9df5-b5993a7fce67'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:32 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.info" returned: 0 in 0.429s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:32 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.info is being set with open permissions: ugo+rw
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:32 devstack sudo[101705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.info
Nov 03 08:12:32 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:32 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:32 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Deleted volume successfully.
Nov 03 08:12:32 devstack sudo[101707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:32 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-54c42272-e0be-49dd-999c-fa7d6864e0c2 tempest-VolumesMetadataTest-1921080518 None] Lock "cinder-8fe72ee3-06f4-4b10-b6a8-0010a98f3989-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:32 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.340s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:32 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:33 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Deleted volume successfully.
Nov 03 08:12:33 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.info" returned: 0 in 0.424s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.750s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d8715abe-5d11-47a2-a8c1-9f4ec378009b tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-d8f688f5-6765-45b3-9c2d-d82ebb3b2689-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:33 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-dd12738a-31be-40d6-8535-3c44341b62f9 tempest-CinderUnicodeTest-963132091 None] Create snapshot completed successfully
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Acquiring lock "cinder-d1cfb67e-f6a5-49e1-9225-4f64c21cdc51-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Lock "cinder-d1cfb67e-f6a5-49e1-9225-4f64c21cdc51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Acquiring lock "cinder-quobyte-4c99e104-59a2-48c3-b6c3-cc243f680d2d" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Lock "cinder-quobyte-4c99e104-59a2-48c3-b6c3-cc243f680d2d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Acquiring lock "cinder-quobyte-d1cfb67e-f6a5-49e1-9225-4f64c21cdc51" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Lock "cinder-quobyte-d1cfb67e-f6a5-49e1-9225-4f64c21cdc51" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Deleting offline snapshot d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 of volume 4c99e104-59a2-48c3-b6c3-cc243f680d2d {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] snapshot_file for this snap is: volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca89cf6-fe5a-46e1-b1f9-399cd06c1bf1]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:33 devstack sudo[101712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51
Nov 03 08:12:33 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-6cbf0c9b-2dab-4434-8da3-81fa888938ad-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-6cbf0c9b-2dab-4434-8da3-81fa888938ad-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "cinder-quobyte-6cbf0c9b-2dab-4434-8da3-81fa888938ad" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-6cbf0c9b-2dab-4434-8da3-81fa888938ad" acquired by "delete_volume" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d393db4f-4140-4855-b557-ce9a1d2d999a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:34 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51" returned: 0 in 0.493s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[183ff8ba-f72f-4738-97c9-4d0ce772525c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:34 devstack sudo[101717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad
Nov 03 08:12:34 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:34 devstack sudo[101721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d
Nov 03 08:12:34 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:34 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad" returned: 0 in 0.492s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:34 devstack sudo[101727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad
Nov 03 08:12:34 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:34 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d" returned: 0 in 0.519s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:34 devstack sudo[101767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51
Nov 03 08:12:34 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:34 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6cbf0c9b-2dab-4434-8da3-81fa888938ad" returned: 0 in 0.374s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-quobyte-6cbf0c9b-2dab-4434-8da3-81fa888938ad" released by "delete_volume" :: held 0.949s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Created reservations ['a181bca2-9158-4537-af5b-b9db29268a4c', 'e1462500-9fd0-4f3e-a110-4dcf99aaeb7a', '09456a37-8536-4dda-838b-151e356f8908', '7e9fc363-7ba5-412a-892e-7e3b9f39375d'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:35 devstack sudo[101773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:35 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:35 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51" returned: 0 in 0.650s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:35 devstack sudo[101778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51
Nov 03 08:12:35 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:35 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.357s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Deleted volume successfully.
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fd4b1a72-3124-4cc2-9365-24a0c220965e tempest-VolumesSnapshotTestJSON-1805349623 None] Lock "cinder-6cbf0c9b-2dab-4434-8da3-81fa888938ad-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:35 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d.d1cfb67e-f6a5-49e1-9225-4f64c21cdc51" returned: 0 in 0.302s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Lock "cinder-quobyte-d1cfb67e-f6a5-49e1-9225-4f64c21cdc51" released by "_delete_snapshot" :: held 2.135s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Lock "cinder-quobyte-4c99e104-59a2-48c3-b6c3-cc243f680d2d" released by "delete_snapshot" :: held 2.163s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Created reservations ['6f1ae720-a936-4bcb-a524-64296601c682', 'e5d1a165-0e22-4562-bbb5-132ba67ebb09', '144a694c-56a3-46ad-9570-9e2f5c1d0c38', 'e1660cce-c6b6-4157-9791-3c71b7c6769e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Delete snapshot completed successfully.
Nov 03 08:12:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7a3a6c68-b0ae-4364-99a4-db546f245b17 tempest-CinderUnicodeTest-963132091 None] Lock "cinder-d1cfb67e-f6a5-49e1-9225-4f64c21cdc51-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Acquiring lock "cinder-4c99e104-59a2-48c3-b6c3-cc243f680d2d-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Lock "cinder-4c99e104-59a2-48c3-b6c3-cc243f680d2d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Acquiring lock "cinder-quobyte-4c99e104-59a2-48c3-b6c3-cc243f680d2d" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Lock "cinder-quobyte-4c99e104-59a2-48c3-b6c3-cc243f680d2d" acquired by "delete_volume" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:36 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f820033-f274-4355-84d9-69c98ecb02ef]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:36 devstack sudo[101782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d
Nov 03 08:12:36 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:37 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d" returned: 0 in 0.553s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:37 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d
Nov 03 08:12:37 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:37 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-4c99e104-59a2-48c3-b6c3-cc243f680d2d" returned: 0 in 0.307s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Lock "cinder-quobyte-4c99e104-59a2-48c3-b6c3-cc243f680d2d" released by "delete_volume" :: held 0.983s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Created reservations ['fd57a20f-a862-418c-82a5-26412aad5af9', '49dd308a-5635-41b7-ad36-3ef7f92af3ed', '074d9f44-0821-46c1-95a2-111a3b91f651', '17ed3d37-b3ff-4cbb-8899-7a5c33a3a813'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:37 devstack sudo[101792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:37 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:38 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.321s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:38 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:38 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Deleted volume successfully.
Nov 03 08:12:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3c9b3abf-dacb-42dd-8267-51780d3c7620 tempest-CinderUnicodeTest-963132091 None] Lock "cinder-4c99e104-59a2-48c3-b6c3-cc243f680d2d-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:38 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Flow 'volume_create_manager' (abdd1b6d-c5b2-4c76-afda-dde0f47ed346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ee3814-1e0d-402c-b7c1-339a21c7cff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ee3814-1e0d-402c-b7c1-339a21c7cff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1919844661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db888b2-d3b2-468c-9ec9-1987d5bee911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='156a8d403c3740e1a2a7c77472875d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:39Z,use_quota=True,user_id='34ab7abd3362460fa69a39e6248aba7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fa6c8b-10c8-4c41-892d-8d1da7eba1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fa6c8b-10c8-4c41-892d-8d1da7eba1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895e2045-5637-4635-9b9f-5ce3f6bc1779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895e2045-5637-4635-9b9f-5ce3f6bc1779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2db888b2-d3b2-468c-9ec9-1987d5bee911', 'volume_name': 'volume-2db888b2-d3b2-468c-9ec9-1987d5bee911', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013120de-d56c-4a80-90d9-56e7fc92920b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013120de-d56c-4a80-90d9-56e7fc92920b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29774455-8f05-48cb-98d1-10381d9c6703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:39 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Volume 2db888b2-d3b2-468c-9ec9-1987d5bee911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2db888b2-d3b2-468c-9ec9-1987d5bee911', 'volume_size': 1}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1919844661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db888b2-d3b2-468c-9ec9-1987d5bee911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='156a8d403c3740e1a2a7c77472875d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:39Z,use_quota=True,user_id='34ab7abd3362460fa69a39e6248aba7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Creating volume 2db888b2-d3b2-468c-9ec9-1987d5bee911 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:39 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Acquiring lock "cinder-2c819c8f-6084-4761-b74d-78c96bc5ce46-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:39 devstack sudo[101797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911 1073741824
Nov 03 08:12:39 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Lock "cinder-2c819c8f-6084-4761-b74d-78c96bc5ce46-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Acquiring lock "cinder-quobyte-2c819c8f-6084-4761-b74d-78c96bc5ce46" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Lock "cinder-quobyte-2c819c8f-6084-4761-b74d-78c96bc5ce46" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[69df7304-51c1-4c29-8670-0a79b5347425]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:39 devstack sudo[101799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46
Nov 03 08:12:39 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:39 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911 1073741824" returned: 0 in 0.562s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:39 devstack sudo[101808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911
Nov 03 08:12:39 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:39 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46" returned: 0 in 0.432s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:39 devstack sudo[101810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46
Nov 03 08:12:39 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:39 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911" returned: 0 in 0.306s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29774455-8f05-48cb-98d1-10381d9c6703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db888b2-d3b2-468c-9ec9-1987d5bee911', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac94a209-77f8-4627-9256-1795e990df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:40 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Volume volume-2db888b2-d3b2-468c-9ec9-1987d5bee911 (2db888b2-d3b2-468c-9ec9-1987d5bee911): created successfully
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac94a209-77f8-4627-9256-1795e990df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:40 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Flow 'volume_create_manager' (abdd1b6d-c5b2-4c76-afda-dde0f47ed346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2c819c8f-6084-4761-b74d-78c96bc5ce46" returned: 0 in 0.346s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Lock "cinder-quobyte-2c819c8f-6084-4761-b74d-78c96bc5ce46" released by "delete_volume" :: held 0.847s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:40 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-6a56ac8b-5cf5-4837-83f7-9bdab11ba60f tempest-VolumesTransfersV357Test-1016920565 None] Created volume successfully.
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Created reservations ['134cc938-bb3e-47d7-b0f0-1db4a38002e8', 'bd936997-54d1-43f6-9dc3-c6760a4df6fb', '12084735-f82f-4cdf-bed7-15b4e222e70d', 'b880777f-0e85-486a-b9b2-65a9f7dee819'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:40 devstack sudo[101814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:40 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:40 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.260s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:40 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Deleted volume successfully.
Nov 03 08:12:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ecd91658-3660-4688-8cbf-63a87b1d214d tempest-CinderUnicodeTest-963132091 None] Lock "cinder-2c819c8f-6084-4761-b74d-78c96bc5ce46-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:42 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-6fa2c696-fcb1-4051-92a1-e0d372249550 tempest-VolumesTransfersV357Test-1357163580 None] Transfer volume completed successfully.
Nov 03 08:12:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Acquiring lock "cinder-2db888b2-d3b2-468c-9ec9-1987d5bee911-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Lock "cinder-2db888b2-d3b2-468c-9ec9-1987d5bee911-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Acquiring lock "cinder-quobyte-2db888b2-d3b2-468c-9ec9-1987d5bee911" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Lock "cinder-quobyte-2db888b2-d3b2-468c-9ec9-1987d5bee911" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:43 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0f1902-b12c-41b5-a79f-034917ebc444]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:43 devstack sudo[101819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911
Nov 03 08:12:43 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:44 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911" returned: 0 in 0.567s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:44 devstack sudo[101825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911
Nov 03 08:12:44 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:44 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2db888b2-d3b2-468c-9ec9-1987d5bee911" returned: 0 in 0.341s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (712218e9-5f81-49fb-b54c-052d29c01958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afa0f0d-656c-4884-ba3e-3b0ee4428932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Lock "cinder-quobyte-2db888b2-d3b2-468c-9ec9-1987d5bee911" released by "delete_volume" :: held 1.025s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afa0f0d-656c-4884-ba3e-3b0ee4428932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1023328167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5541d65-08ec-4693-b5e1-f1ee43c47def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:44Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25924ff1-c1e7-4f95-a843-9f092280fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25924ff1-c1e7-4f95-a843-9f092280fa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24981aa5-0656-4e6f-87a4-af34c6164c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24981aa5-0656-4e6f-87a4-af34c6164c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5541d65-08ec-4693-b5e1-f1ee43c47def', 'volume_name': 'volume-a5541d65-08ec-4693-b5e1-f1ee43c47def', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afdd557-176b-49e0-b9a0-17b8347c4808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afdd557-176b-49e0-b9a0-17b8347c4808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e9f9bc-09d5-4400-ac06-3573991a6a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:44 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume a5541d65-08ec-4693-b5e1-f1ee43c47def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5541d65-08ec-4693-b5e1-f1ee43c47def', 'volume_size': 1}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1023328167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5541d65-08ec-4693-b5e1-f1ee43c47def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:44Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Creating volume a5541d65-08ec-4693-b5e1-f1ee43c47def {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:44 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:44 devstack sudo[101828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def 1073741824
Nov 03 08:12:44 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Created reservations ['9b33c4e3-7f02-4b31-8c2a-3c035e4f3fb2', '266763dc-0fd0-4693-831c-1f8d7ca816aa', 'ab7eec4d-d467-4c24-ad49-7ff27485f3d0', '7668be8b-b8ef-4468-8966-594326ffaf3f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:44 devstack sudo[101830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:44 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:44 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:44 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Deleted volume successfully.
Nov 03 08:12:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0d694759-a065-48ef-b27c-80489102c155 tempest-VolumesTransfersV357Test-965169006 None] Lock "cinder-2db888b2-d3b2-468c-9ec9-1987d5bee911-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:45 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def 1073741824" returned: 0 in 0.493s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:45 devstack sudo[101836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def
Nov 03 08:12:45 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:45 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def" returned: 0 in 0.271s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e9f9bc-09d5-4400-ac06-3573991a6a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5541d65-08ec-4693-b5e1-f1ee43c47def', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c406d0ea-e2d7-47d5-8c3a-fb817aa5b9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:45 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume volume-a5541d65-08ec-4693-b5e1-f1ee43c47def (a5541d65-08ec-4693-b5e1-f1ee43c47def): created successfully
Nov 03 08:12:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c406d0ea-e2d7-47d5-8c3a-fb817aa5b9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (712218e9-5f81-49fb-b54c-052d29c01958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:45 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-815ab695-a285-4866-aaed-2e038fafac78 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created volume successfully.
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Flow 'volume_create_manager' (4695e715-49ca-4efd-ba85-87f529fe3d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046f43bb-fdcc-4100-aa70-3baccad73b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046f43bb-fdcc-4100-aa70-3baccad73b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1213413992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89e0489-8a32-4c9c-b3ad-0dcec6e00216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='156a8d403c3740e1a2a7c77472875d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:46Z,use_quota=True,user_id='34ab7abd3362460fa69a39e6248aba7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3347d19a-71ac-450b-b90d-775e78e31c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3347d19a-71ac-450b-b90d-775e78e31c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e142ffd-0ac8-4b59-a342-b2ae68616aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e142ffd-0ac8-4b59-a342-b2ae68616aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89e0489-8a32-4c9c-b3ad-0dcec6e00216', 'volume_name': 'volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0271c47f-a641-460d-b168-3df9d9aeafdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0271c47f-a641-460d-b168-3df9d9aeafdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4029c464-5dbc-4562-87ee-89b93f2fbd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:46 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Volume f89e0489-8a32-4c9c-b3ad-0dcec6e00216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216', 'volume_size': 1}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1213413992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89e0489-8a32-4c9c-b3ad-0dcec6e00216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='156a8d403c3740e1a2a7c77472875d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:46Z,use_quota=True,user_id='34ab7abd3362460fa69a39e6248aba7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Creating volume f89e0489-8a32-4c9c-b3ad-0dcec6e00216 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:46 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:46 devstack sudo[101839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216 1073741824
Nov 03 08:12:46 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:46 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216 1073741824" returned: 0 in 0.482s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:46 devstack sudo[101845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216
Nov 03 08:12:46 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:46 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (a47a4399-bf8f-4586-8895-e405a4b69cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59195d35-cca8-49c8-bb45-5485746a0b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59195d35-cca8-49c8-bb45-5485746a0b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-54006132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85bdaf5-0a35-43bf-b622-d0ad3b08e875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:47Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774ff976-8c48-4a61-8230-f716d96e96df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774ff976-8c48-4a61-8230-f716d96e96df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b892e1-a190-4aa4-8b0a-3c7ecabc76a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b892e1-a190-4aa4-8b0a-3c7ecabc76a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c85bdaf5-0a35-43bf-b622-d0ad3b08e875', 'volume_name': 'volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a34c5b-859c-4b17-9e95-d8244f6e2cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a34c5b-859c-4b17-9e95-d8244f6e2cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9058094-73fb-473c-b53a-18236226c45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume c85bdaf5-0a35-43bf-b622-d0ad3b08e875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875', 'volume_size': 1}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216" returned: 0 in 0.352s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-54006132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85bdaf5-0a35-43bf-b622-d0ad3b08e875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:47Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Creating volume c85bdaf5-0a35-43bf-b622-d0ad3b08e875 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:47 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4029c464-5dbc-4562-87ee-89b93f2fbd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd873e8-3e71-4acf-9c96-405b86cc5ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack sudo[101848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875 1073741824
Nov 03 08:12:47 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:47 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Volume volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216 (f89e0489-8a32-4c9c-b3ad-0dcec6e00216): created successfully
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd873e8-3e71-4acf-9c96-405b86cc5ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Flow 'volume_create_manager' (4695e715-49ca-4efd-ba85-87f529fe3d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:47 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-efa77786-43df-4ffa-946e-89746e9b164a tempest-VolumesTransfersV357Test-1016920565 None] Created volume successfully.
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (b5400a0e-c1c5-4d55-9174-95d950cab979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d260cce4-4750-45c0-8758-31fbab285ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d260cce4-4750-45c0-8758-31fbab285ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-756165234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b64a01-de49-4ae5-b827-3f819f6fe50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:47Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc712143-6364-4b15-b1d3-bcd80a809d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc712143-6364-4b15-b1d3-bcd80a809d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6375fe6-7b6c-415b-8130-b21963b8f7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6375fe6-7b6c-415b-8130-b21963b8f7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b64a01-de49-4ae5-b827-3f819f6fe50e', 'volume_name': 'volume-12b64a01-de49-4ae5-b827-3f819f6fe50e', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef0167c-9e80-404f-9b32-799b9ec42f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef0167c-9e80-404f-9b32-799b9ec42f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3c8e6c-8268-4f53-aa34-8dfd89cd06f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:47 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume 12b64a01-de49-4ae5-b827-3f819f6fe50e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b64a01-de49-4ae5-b827-3f819f6fe50e', 'volume_size': 1}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:47 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875 1073741824" returned: 0 in 0.666s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:47 devstack sudo[101854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875
Nov 03 08:12:47 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (354349a0-551e-4484-b768-90067ff10d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365cdc3d-3153-4e09-a568-94c271516cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365cdc3d-3153-4e09-a568-94c271516cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1524455759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005871df-3d0c-4ba2-b7e6-99339e3d25a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:48Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d30f22-2bb9-4233-b94c-49eccea6a741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d30f22-2bb9-4233-b94c-49eccea6a741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246c930b-cfd2-4ec3-89fd-2d7bd8bc1a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246c930b-cfd2-4ec3-89fd-2d7bd8bc1a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005871df-3d0c-4ba2-b7e6-99339e3d25a2', 'volume_name': 'volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5e3a2a-4f59-489d-ad5c-0bdba7a1212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5e3a2a-4f59-489d-ad5c-0bdba7a1212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75168e0-de59-494c-8824-c05f12b68f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume 005871df-3d0c-4ba2-b7e6-99339e3d25a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2', 'volume_size': 1}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:48 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875" returned: 0 in 0.535s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-756165234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b64a01-de49-4ae5-b827-3f819f6fe50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:47Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Creating volume 12b64a01-de49-4ae5-b827-3f819f6fe50e {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:48 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:48 devstack sudo[101857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e 1073741824
Nov 03 08:12:48 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9058094-73fb-473c-b53a-18236226c45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd7e4f3-0ac9-4ee1-9d7c-ae22d588496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875 (c85bdaf5-0a35-43bf-b622-d0ad3b08e875): created successfully
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd7e4f3-0ac9-4ee1-9d7c-ae22d588496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (a47a4399-bf8f-4586-8895-e405a4b69cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (1f2c7df9-5cbc-4a7e-87aa-cffee9b09b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce8868e-cd69-4611-b690-320325863b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce8868e-cd69-4611-b690-320325863b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1896937446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85d703a-f391-47b1-90f0-3ffdd2d3e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:48Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df395d8-10c4-45cf-85a0-b5383208c183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df395d8-10c4-45cf-85a0-b5383208c183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9c4b89-21fc-4449-9097-da99950390cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9c4b89-21fc-4449-9097-da99950390cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85d703a-f391-47b1-90f0-3ffdd2d3e79d', 'volume_name': 'volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e218ca81-3f93-4c3b-bf7a-75cd2549e940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e218ca81-3f93-4c3b-bf7a-75cd2549e940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56635a0d-b7a9-4be9-8efb-8f71dc64c134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:48 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume f85d703a-f391-47b1-90f0-3ffdd2d3e79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d', 'volume_size': 1}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:48 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-afcea637-6fec-4d4b-b4e6-9fc706f2063e tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created volume successfully.
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Acquiring lock "cinder-f89e0489-8a32-4c9c-b3ad-0dcec6e00216-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Lock "cinder-f89e0489-8a32-4c9c-b3ad-0dcec6e00216-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:12:48 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (ab5795b3-723e-4eaf-9c20-abca1b6d5bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5968b866-e6df-4ac3-91c8-cc5a4cf15524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Acquiring lock "cinder-quobyte-f89e0489-8a32-4c9c-b3ad-0dcec6e00216" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5968b866-e6df-4ac3-91c8-cc5a4cf15524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574532716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3459601f-0f53-47ce-846a-dddbe941b5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:49Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f409c62b-f228-4fdc-b2d3-334fd02704d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:49 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f409c62b-f228-4fdc-b2d3-334fd02704d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27e35fc-fe71-40b6-bf2f-87d84185fa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27e35fc-fe71-40b6-bf2f-87d84185fa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3459601f-0f53-47ce-846a-dddbe941b5da', 'volume_name': 'volume-3459601f-0f53-47ce-846a-dddbe941b5da', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebb045e-f56f-4a92-9379-e4e4f66e17e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebb045e-f56f-4a92-9379-e4e4f66e17e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd0c165-7eb1-4125-9571-268a204be5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:49 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume 3459601f-0f53-47ce-846a-dddbe941b5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3459601f-0f53-47ce-846a-dddbe941b5da', 'volume_size': 1}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e 1073741824" returned: 0 in 0.689s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Lock "cinder-quobyte-f89e0489-8a32-4c9c-b3ad-0dcec6e00216" acquired by "delete_volume" :: waited 0.068s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa8560b-9a27-4b95-8cde-d55f2326cd9e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:49 devstack sudo[101864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e
Nov 03 08:12:49 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:49 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216
Nov 03 08:12:49 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:49 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e" returned: 0 in 0.256s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.110s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1524455759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005871df-3d0c-4ba2-b7e6-99339e3d25a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:48Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Creating volume 005871df-3d0c-4ba2-b7e6-99339e3d25a2 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:49 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3c8e6c-8268-4f53-aa34-8dfd89cd06f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b64a01-de49-4ae5-b827-3f819f6fe50e', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef18b307-f1d2-49c5-bd36-486a48e69861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:49 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2 1073741824
Nov 03 08:12:49 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:49 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume volume-12b64a01-de49-4ae5-b827-3f819f6fe50e (12b64a01-de49-4ae5-b827-3f819f6fe50e): created successfully
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef18b307-f1d2-49c5-bd36-486a48e69861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (b5400a0e-c1c5-4d55-9174-95d950cab979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:49 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8ca67d0e-5161-48c5-b535-293d86c2b47a tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created volume successfully.
Nov 03 08:12:49 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216" returned: 0 in 0.412s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:49 devstack sudo[101873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216
Nov 03 08:12:49 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:49 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f89e0489-8a32-4c9c-b3ad-0dcec6e00216" returned: 0 in 0.269s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Lock "cinder-quobyte-f89e0489-8a32-4c9c-b3ad-0dcec6e00216" released by "delete_volume" :: held 0.737s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Created reservations ['76f24ac8-eaf2-4500-a043-71a2dcbce2e2', 'b38698e2-167d-4b29-8a01-37749289542d', '24ae524b-7a94-4bd6-b9c2-e9c874e296f5', 'ab812575-dc72-4335-8358-8aa4096ad38b'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:50 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2 1073741824" returned: 0 in 0.616s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:50 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:50 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:50 devstack sudo[101883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2
Nov 03 08:12:50 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:50 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.399s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:50 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Deleted volume successfully.
Nov 03 08:12:50 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a23b5704-fe38-43fb-acd7-021693f84488 tempest-VolumesTransfersV357Test-965169006 None] Lock "cinder-f89e0489-8a32-4c9c-b3ad-0dcec6e00216-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2" returned: 0 in 0.359s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.767s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1896937446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85d703a-f391-47b1-90f0-3ffdd2d3e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:48Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Creating volume f85d703a-f391-47b1-90f0-3ffdd2d3e79d {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:50 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75168e0-de59-494c-8824-c05f12b68f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5795a0-2c28-47dd-89f6-e739f818e800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:50 devstack sudo[101887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d 1073741824
Nov 03 08:12:50 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:50 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2 (005871df-3d0c-4ba2-b7e6-99339e3d25a2): created successfully
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5795a0-2c28-47dd-89f6-e739f818e800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (354349a0-551e-4484-b768-90067ff10d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:50 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d03a45b3-0cbc-40e7-9af5-829fc877b938 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created volume successfully.
Nov 03 08:12:51 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d 1073741824" returned: 0 in 0.567s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:51 devstack sudo[101894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d
Nov 03 08:12:51 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:51 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d" returned: 0 in 0.316s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.323s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574532716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3459601f-0f53-47ce-846a-dddbe941b5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5426691bfc6482aaecc7fa66414449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:12:49Z,use_quota=True,user_id='b545d456dc9f4d1b86ab266e085dd31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Creating volume 3459601f-0f53-47ce-846a-dddbe941b5da {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:12:51 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56635a0d-b7a9-4be9-8efb-8f71dc64c134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:51 devstack sudo[101897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da 1073741824
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a910af-c9ec-4c8d-ba8d-971ef35aa93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:51 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:51 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d (f85d703a-f391-47b1-90f0-3ffdd2d3e79d): created successfully
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a910af-c9ec-4c8d-ba8d-971ef35aa93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (1f2c7df9-5cbc-4a7e-87aa-cffee9b09b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:51 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-456de7b4-ec93-4cef-ae29-7193ba177ea0 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created volume successfully.
Nov 03 08:12:51 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da 1073741824" returned: 0 in 0.573s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:52 devstack sudo[101903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da
Nov 03 08:12:52 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:52 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da" returned: 0 in 0.308s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:12:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd0c165-7eb1-4125-9571-268a204be5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3459601f-0f53-47ce-846a-dddbe941b5da', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3958298-ed6f-4703-8a8c-7ba5a54994ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:12:52 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Volume volume-3459601f-0f53-47ce-846a-dddbe941b5da (3459601f-0f53-47ce-846a-dddbe941b5da): created successfully
Nov 03 08:12:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3958298-ed6f-4703-8a8c-7ba5a54994ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:12:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Flow 'volume_create_manager' (ab5795b3-723e-4eaf-9c20-abca1b6d5bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:12:52 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-69dcc8eb-017c-4068-aa48-185b8dcd6989 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created volume successfully.
Nov 03 08:12:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-3459601f-0f53-47ce-846a-dddbe941b5da-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-3459601f-0f53-47ce-846a-dddbe941b5da-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-quobyte-3459601f-0f53-47ce-846a-dddbe941b5da" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:53 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-3459601f-0f53-47ce-846a-dddbe941b5da" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:53 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[939ed544-329f-4dc7-88cc-3f469df51c00]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:53 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da
Nov 03 08:12:53 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:54 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da" returned: 0 in 0.450s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:54 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da
Nov 03 08:12:54 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:54 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3459601f-0f53-47ce-846a-dddbe941b5da" returned: 0 in 0.373s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-3459601f-0f53-47ce-846a-dddbe941b5da" released by "delete_volume" :: held 0.878s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created reservations ['b58038d5-0563-455f-85b5-330f25e36ff7', '2fac8df4-5713-4952-87f8-ad6fe102b8a7', 'c5cadc1e-42bc-483d-a3b8-29e8a1ae8176', '18693d5d-345c-4c3f-9796-bb86b89344f8'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:54 devstack sudo[101915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:54 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-f85d703a-f391-47b1-90f0-3ffdd2d3e79d-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-f85d703a-f391-47b1-90f0-3ffdd2d3e79d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-quobyte-f85d703a-f391-47b1-90f0-3ffdd2d3e79d" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-f85d703a-f391-47b1-90f0-3ffdd2d3e79d" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d18ed6-e3cf-455d-942a-89bb955542a3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:55 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.334s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Deleted volume successfully.
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bf1ab617-15c9-44bf-b63b-bd1117599d20 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-3459601f-0f53-47ce-846a-dddbe941b5da-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:55 devstack sudo[101917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d
Nov 03 08:12:55 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:55 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d" returned: 0 in 0.482s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:55 devstack sudo[101923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d
Nov 03 08:12:55 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:55 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f85d703a-f391-47b1-90f0-3ffdd2d3e79d" returned: 0 in 0.323s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-f85d703a-f391-47b1-90f0-3ffdd2d3e79d" released by "delete_volume" :: held 0.867s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created reservations ['a4ab5811-efa0-4f9c-ac6a-8711edde9a5b', '4904b199-fb17-4e84-a70e-5318350e1aea', '2664dc56-2d57-4b0c-9ab0-d7f43d1ce1d9', 'c3cf76e2-9a48-4263-8e0b-17893e3c2882'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:56 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:56 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-005871df-3d0c-4ba2-b7e6-99339e3d25a2-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-005871df-3d0c-4ba2-b7e6-99339e3d25a2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-quobyte-005871df-3d0c-4ba2-b7e6-99339e3d25a2" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-005871df-3d0c-4ba2-b7e6-99339e3d25a2" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6b5be3-df36-4b61-b7ac-a92500632c5b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:56 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.370s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:56 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Deleted volume successfully.
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e166da19-b785-4f7b-a4d9-5edfece4643b tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-f85d703a-f391-47b1-90f0-3ffdd2d3e79d-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:56 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2
Nov 03 08:12:56 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:56 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2" returned: 0 in 0.470s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:56 devstack sudo[101934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2
Nov 03 08:12:56 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:57 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-005871df-3d0c-4ba2-b7e6-99339e3d25a2" returned: 0 in 0.324s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-005871df-3d0c-4ba2-b7e6-99339e3d25a2" released by "delete_volume" :: held 0.863s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created reservations ['b07f678e-5e37-44d3-b857-86e7c2da5a0d', '1991dea4-8c5e-4f83-925f-a7e71dc9317b', '02866348-f5ae-45e6-b43b-eaba1bf24fc3', '74389aee-45dd-41c8-87a3-8a7fd549597e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:57 devstack sudo[101937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:57 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-12b64a01-de49-4ae5-b827-3f819f6fe50e-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-12b64a01-de49-4ae5-b827-3f819f6fe50e-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=238,cinder:SELECT=188,cinder:INSERT=62,cinder:DELETE=19 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=180,cinder:INSERT=58,cinder:UPDATE=239,cinder:DELETE=19 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-quobyte-12b64a01-de49-4ae5-b827-3f819f6fe50e" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-12b64a01-de49-4ae5-b827-3f819f6fe50e" acquired by "delete_volume" :: waited 0.033s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:57 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.370s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d910fcb-8e49-419e-a1c7-a91e8c951cc4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Deleted volume successfully.
Nov 03 08:12:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d0210d1e-233a-497d-a800-89cb7a6da131 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-005871df-3d0c-4ba2-b7e6-99339e3d25a2-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:57 devstack sudo[101940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e
Nov 03 08:12:57 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:58 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e" returned: 0 in 0.426s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:58 devstack sudo[101945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e
Nov 03 08:12:58 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-12b64a01-de49-4ae5-b827-3f819f6fe50e" returned: 0 in 0.274s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:58 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-12b64a01-de49-4ae5-b827-3f819f6fe50e" released by "delete_volume" :: held 0.777s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created reservations ['cb30b4f9-b1ee-417e-a817-5a1a47e11e0d', 'bdb1358b-1a4e-416e-b709-db95985e9970', '3c79a3a8-9388-4912-bac9-26785e4e3aa5', '93430a98-53a3-4623-8fb4-3600c63c045f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-c85bdaf5-0a35-43bf-b622-d0ad3b08e875-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:58 devstack sudo[101948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:58 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-c85bdaf5-0a35-43bf-b622-d0ad3b08e875-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-quobyte-c85bdaf5-0a35-43bf-b622-d0ad3b08e875" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-c85bdaf5-0a35-43bf-b622-d0ad3b08e875" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0164592a-8606-4a5b-88e9-eebe97e5cb45]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:58 devstack sudo[101950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875
Nov 03 08:12:58 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:58 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.393s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:58 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:12:59 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Deleted volume successfully.
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3547279a-c8f6-43e3-a04c-53d6a0207392 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-12b64a01-de49-4ae5-b827-3f819f6fe50e-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:59 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875" returned: 0 in 0.452s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:59 devstack sudo[101957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875
Nov 03 08:12:59 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:59 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c85bdaf5-0a35-43bf-b622-d0ad3b08e875" returned: 0 in 0.284s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-c85bdaf5-0a35-43bf-b622-d0ad3b08e875" released by "delete_volume" :: held 0.815s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created reservations ['c01a66c9-bb49-45c6-a4c7-535539171c4b', '6204757f-cff1-4a29-b8b7-c555d576c2ea', 'd01aeb7e-77cf-4c05-9ccf-9af1fea86434', '14bff2ba-8bf5-4466-8c6c-0f17da25ea5d'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:12:59 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:12:59 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-a5541d65-08ec-4693-b5e1-f1ee43c47def-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-a5541d65-08ec-4693-b5e1-f1ee43c47def-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "cinder-quobyte-a5541d65-08ec-4693-b5e1-f1ee43c47def" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-a5541d65-08ec-4693-b5e1-f1ee43c47def" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1b68d3-e88a-437a-a724-6ab03d8dcb18]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:12:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:00 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.391s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:13:00 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Deleted volume successfully.
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d40eb39f-5520-4803-8c10-c18abeeb1259 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-c85bdaf5-0a35-43bf-b622-d0ad3b08e875-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:13:00 devstack sudo[101962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def
Nov 03 08:13:00 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:00 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def" returned: 0 in 0.462s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:00 devstack sudo[101968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def
Nov 03 08:13:00 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:00 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a5541d65-08ec-4693-b5e1-f1ee43c47def" returned: 0 in 0.270s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-quobyte-a5541d65-08ec-4693-b5e1-f1ee43c47def" released by "delete_volume" :: held 0.793s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Created reservations ['22eae40f-0f04-4059-af92-79c4bb0acd5a', '9b570a5b-9d57-4863-b68f-77170be395fc', '83b41ca2-39a6-4709-bdd9-a83da0b80125', '4fc942fc-43b4-48fe-9990-e98c15a04c78'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:13:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:00 devstack sudo[101971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:13:00 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:01 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.298s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:01 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:13:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Deleted volume successfully.
Nov 03 08:13:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-662912cc-b2bd-45bc-9bd8-5b4f0a3697e6 tempest-CreateVolumesFromSourceVolumeTest-442993033 None] Lock "cinder-a5541d65-08ec-4693-b5e1-f1ee43c47def-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:03 devstack sudo[101974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:13:03 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:03 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:13:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:13:10 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=14,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:13:11 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:DELETE=3,cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=23 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Flow 'volume_create_manager' (ec41ed81-ca74-433f-9d43-13fb14331e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8481be1d-a8c2-4d31-b0f5-adbab239eafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8481be1d-a8c2-4d31-b0f5-adbab239eafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2097529985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78e779f-7567-44fc-a559-553b28540b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa0dea095834cdf89a7a3c7b23d6a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:13:12Z,use_quota=True,user_id='5a2df7b046d34740b73add7d553d879a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e765923-82d3-4fce-9791-548a452c1ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e765923-82d3-4fce-9791-548a452c1ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d79b67-00b6-43b4-8229-22ddf1d7eacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d79b67-00b6-43b4-8229-22ddf1d7eacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78e779f-7567-44fc-a559-553b28540b47', 'volume_name': 'volume-d78e779f-7567-44fc-a559-553b28540b47', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fcee78-94ee-4220-8a4c-7a67e90c2f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fcee78-94ee-4220-8a4c-7a67e90c2f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b6c9a2-a1fb-46eb-b900-3966052b20f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:12 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Volume d78e779f-7567-44fc-a559-553b28540b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78e779f-7567-44fc-a559-553b28540b47', 'volume_size': 1}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2097529985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78e779f-7567-44fc-a559-553b28540b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa0dea095834cdf89a7a3c7b23d6a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:13:12Z,use_quota=True,user_id='5a2df7b046d34740b73add7d553d879a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Creating volume d78e779f-7567-44fc-a559-553b28540b47 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:13:12 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:12 devstack sudo[101981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 1073741824
Nov 03 08:13:12 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:12 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 1073741824" returned: 0 in 0.537s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:12 devstack sudo[101987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47
Nov 03 08:13:12 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:13 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47" returned: 0 in 0.345s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:13:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:13:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b6c9a2-a1fb-46eb-b900-3966052b20f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78e779f-7567-44fc-a559-553b28540b47', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac0b791-68f2-4935-b7ab-f5a9e08981f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Volume volume-d78e779f-7567-44fc-a559-553b28540b47 (d78e779f-7567-44fc-a559-553b28540b47): created successfully
Nov 03 08:13:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac0b791-68f2-4935-b7ab-f5a9e08981f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Flow 'volume_create_manager' (ec41ed81-ca74-433f-9d43-13fb14331e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:13:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e2c0c1cf-04c4-4b8c-9c03-cc4606b32c3a tempest-VolumesActionsTest-385096185 None] Created volume successfully.
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Flow 'volume_create_manager' (67d05381-6cd6-43e3-93ba-cfebaea821a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14def6bc-3a43-4f86-9e67-16f45c43093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14def6bc-3a43-4f86-9e67-16f45c43093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1343614162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073ecb24-6c81-416d-89f0-dbed800e3653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c70fbb0685478aa58fe8e3349a9573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:13:20Z,use_quota=True,user_id='05cfb938afc14867b239e901a16b22a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508b4442-27a5-4d5a-bbd6-a52c14fb0ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508b4442-27a5-4d5a-bbd6-a52c14fb0ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba059d5-0442-4165-9296-db913f8be49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba059d5-0442-4165-9296-db913f8be49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073ecb24-6c81-416d-89f0-dbed800e3653', 'volume_name': 'volume-073ecb24-6c81-416d-89f0-dbed800e3653', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2182ea-918a-42be-ac49-8ef6262dc5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2182ea-918a-42be-ac49-8ef6262dc5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21073ff-d8be-4f96-b49c-54668ec4f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:19 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Volume 073ecb24-6c81-416d-89f0-dbed800e3653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073ecb24-6c81-416d-89f0-dbed800e3653', 'volume_size': 1}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1343614162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073ecb24-6c81-416d-89f0-dbed800e3653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c70fbb0685478aa58fe8e3349a9573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:13:20Z,use_quota=True,user_id='05cfb938afc14867b239e901a16b22a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Creating volume 073ecb24-6c81-416d-89f0-dbed800e3653 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:13:19 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:13:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:19 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653 1073741824
Nov 03 08:13:19 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:20 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653 1073741824" returned: 0 in 0.990s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:21 devstack sudo[102181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653
Nov 03 08:13:21 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:21 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653" returned: 0 in 0.495s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:13:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:13:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21073ff-d8be-4f96-b49c-54668ec4f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073ecb24-6c81-416d-89f0-dbed800e3653', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd97b1c3-9e35-40af-ad83-b500b8a82766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:13:21 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Volume volume-073ecb24-6c81-416d-89f0-dbed800e3653 (073ecb24-6c81-416d-89f0-dbed800e3653): created successfully
Nov 03 08:13:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd97b1c3-9e35-40af-ad83-b500b8a82766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:13:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Flow 'volume_create_manager' (67d05381-6cd6-43e3-93ba-cfebaea821a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:13:21 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-00caf665-4c31-48e0-be88-c9974bde1cc6 tempest-TestMinimumBasicScenario-196453450 None] Created volume successfully.
Nov 03 08:13:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-7b25f0dd-cba9-4b90-b35b-fa5f78e3dd4d req-210ed71e-fdf6-47e9-b590-d71dfcd1ee2c tempest-TestMinimumBasicScenario-196453450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:13:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-7b25f0dd-cba9-4b90-b35b-fa5f78e3dd4d req-210ed71e-fdf6-47e9-b590-d71dfcd1ee2c tempest-TestMinimumBasicScenario-196453450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:13:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-7b25f0dd-cba9-4b90-b35b-fa5f78e3dd4d req-210ed71e-fdf6-47e9-b590-d71dfcd1ee2c tempest-TestMinimumBasicScenario-196453450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:13:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-7b25f0dd-cba9-4b90-b35b-fa5f78e3dd4d req-210ed71e-fdf6-47e9-b590-d71dfcd1ee2c tempest-TestMinimumBasicScenario-196453450 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-073ecb24-6c81-416d-89f0-dbed800e3653', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a4a0a6a-913f-4285-8520-5f8a8aee23bd', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:13:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-7b25f0dd-cba9-4b90-b35b-fa5f78e3dd4d req-210ed71e-fdf6-47e9-b590-d71dfcd1ee2c tempest-TestMinimumBasicScenario-196453450 None] attachment_update completed successfully.
Nov 03 08:13:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9799cb1d-6f31-44f9-bb52-c67ef35303b8 tempest-VolumesActionsTest-385096185 None] Acquiring lock "cinder-d78e779f-7567-44fc-a559-553b28540b47" by "attach_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:13:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9799cb1d-6f31-44f9-bb52-c67ef35303b8 tempest-VolumesActionsTest-385096185 None] Lock "cinder-d78e779f-7567-44fc-a559-553b28540b47" acquired by "attach_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:13:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9799cb1d-6f31-44f9-bb52-c67ef35303b8 tempest-VolumesActionsTest-385096185 None] Attaching volume d78e779f-7567-44fc-a559-553b28540b47 to instance 1765184c-1d2d-402a-960e-b5481b58ca68 at mountpoint /dev/vdb on host None.
Nov 03 08:13:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9799cb1d-6f31-44f9-bb52-c67ef35303b8 tempest-VolumesActionsTest-385096185 None] Attach volume completed successfully.
Nov 03 08:13:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9799cb1d-6f31-44f9-bb52-c67ef35303b8 tempest-VolumesActionsTest-385096185 None] Lock "cinder-d78e779f-7567-44fc-a559-553b28540b47" released by "attach_volume" :: held 0.170s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:13:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0f8e08a2-6300-4c7d-b588-a8bab4c3537b tempest-VolumesActionsTest-385096185 None] Acquiring lock "cinder-d78e779f-7567-44fc-a559-553b28540b47-detach_volume" by "detach_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:13:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0f8e08a2-6300-4c7d-b588-a8bab4c3537b tempest-VolumesActionsTest-385096185 None] Lock "cinder-d78e779f-7567-44fc-a559-553b28540b47-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:13:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0f8e08a2-6300-4c7d-b588-a8bab4c3537b tempest-VolumesActionsTest-385096185 None] Detaching volume d78e779f-7567-44fc-a559-553b28540b47 from instance 1765184c-1d2d-402a-960e-b5481b58ca68.
Nov 03 08:13:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0f8e08a2-6300-4c7d-b588-a8bab4c3537b tempest-VolumesActionsTest-385096185 None] Detach volume completed successfully.
Nov 03 08:13:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0f8e08a2-6300-4c7d-b588-a8bab4c3537b tempest-VolumesActionsTest-385096185 None] Lock "cinder-d78e779f-7567-44fc-a559-553b28540b47-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:13:33 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:INSERT=4 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:13:33 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=21,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:13:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0f80cf66-3e64-4eca-8809-7fe0b0a91e14 tempest-VolumesActionsTest-385096185 None] Acquiring lock "cinder-d78e779f-7567-44fc-a559-553b28540b47" by "attach_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:13:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0f80cf66-3e64-4eca-8809-7fe0b0a91e14 tempest-VolumesActionsTest-385096185 None] Lock "cinder-d78e779f-7567-44fc-a559-553b28540b47" acquired by "attach_volume" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:13:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0f80cf66-3e64-4eca-8809-7fe0b0a91e14 tempest-VolumesActionsTest-385096185 None] Attaching volume d78e779f-7567-44fc-a559-553b28540b47 to instance 860b384e-f629-4570-933f-c27197fff33a at mountpoint /dev/vdb on host None.
Nov 03 08:13:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0f80cf66-3e64-4eca-8809-7fe0b0a91e14 tempest-VolumesActionsTest-385096185 None] Attach volume completed successfully.
Nov 03 08:13:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0f80cf66-3e64-4eca-8809-7fe0b0a91e14 tempest-VolumesActionsTest-385096185 None] Lock "cinder-d78e779f-7567-44fc-a559-553b28540b47" released by "attach_volume" :: held 0.094s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:13:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8773b507-505a-4e37-a61a-fa7a3fcf6791 tempest-VolumesActionsTest-385096185 None] Acquiring lock "cinder-d78e779f-7567-44fc-a559-553b28540b47-detach_volume" by "detach_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:13:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8773b507-505a-4e37-a61a-fa7a3fcf6791 tempest-VolumesActionsTest-385096185 None] Lock "cinder-d78e779f-7567-44fc-a559-553b28540b47-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:13:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8773b507-505a-4e37-a61a-fa7a3fcf6791 tempest-VolumesActionsTest-385096185 None] Detaching volume d78e779f-7567-44fc-a559-553b28540b47 from instance 860b384e-f629-4570-933f-c27197fff33a.
Nov 03 08:13:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8773b507-505a-4e37-a61a-fa7a3fcf6791 tempest-VolumesActionsTest-385096185 None] Detach volume completed successfully.
Nov 03 08:13:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8773b507-505a-4e37-a61a-fa7a3fcf6791 tempest-VolumesActionsTest-385096185 None] Lock "cinder-d78e779f-7567-44fc-a559-553b28540b47-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:13:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:13:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:13:40 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fe04be-2d31-4f06-9b7e-c7597e049184]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:13:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:40 devstack sudo[102833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47
Nov 03 08:13:40 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:40 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47" returned: 0 in 0.348s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:40 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d808c79-e947-4856-ad44-50766aad6d62]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:13:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:40 devstack sudo[102839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47
Nov 03 08:13:40 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:40 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47" returned: 0 in 0.386s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.56dfbb43-b80f-47da-9dc7-679066b99f6259wrm6_c.img {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:41 devstack sudo[102847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.56dfbb43-b80f-47da-9dc7-679066b99f6259wrm6_c.img
Nov 03 08:13:41 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:45 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:13:47 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.56dfbb43-b80f-47da-9dc7-679066b99f6259wrm6_c.img" returned: 0 in 6.697s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:47 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dab4d0-b9ce-44ca-b17d-7ade38eb6de4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:13:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:13:47 devstack sudo[102914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47
Nov 03 08:13:47 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:13:48 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root
Nov 03 08:13:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47" returned: 0 in 0.561s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:13:48 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.56dfbb43-b80f-47da-9dc7-679066b99f6259wrm6_c.img {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:13:48 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Converted 1024.00 MB image at 152.88 MB/s
Nov 03 08:13:48 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] 56dfbb43-b80f-47da-9dc7-679066b99f62 was raw, no need to convert to raw {{(pid=86851) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 03 08:13:58 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:13:58 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:03 devstack sudo[102927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:14:03 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:03 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.279s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:14:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:14:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.316s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Uploaded volume to glance image-id: 56dfbb43-b80f-47da-9dc7-679066b99f62. {{(pid=86851) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 08:14:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1b6f669a-4b94-452f-b915-759724e3cf9f tempest-VolumesActionsTest-385096185 None] Copy volume to image completed successfully.
Nov 03 08:14:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7e9ac4-9ddf-4523-bd86-55cbfe139cb8]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:08 devstack sudo[102935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47
Nov 03 08:14:08 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:08 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47" returned: 0 in 0.371s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ce689b-cd6c-42ff-8f86-f4ea66ef82e5]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:08 devstack sudo[102940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47
Nov 03 08:14:08 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:09 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47" returned: 0 in 0.415s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:09 devstack sudo[102946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img
Nov 03 08:14:09 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-7ba344ca-aee6-4d40-94a7-b3d7864e4bd2 req-524d90bf-1704-4656-88cd-b272b55c590d tempest-TestMinimumBasicScenario-196453450 None] Terminate volume connection completed successfully.
Nov 03 08:14:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-7ba344ca-aee6-4d40-94a7-b3d7864e4bd2 req-524d90bf-1704-4656-88cd-b272b55c590d tempest-TestMinimumBasicScenario-196453450 None] Deleting attachment 6a4a0a6a-913f-4285-8520-5f8a8aee23bd. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:14:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Acquiring lock "cinder-073ecb24-6c81-416d-89f0-dbed800e3653-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Lock "cinder-073ecb24-6c81-416d-89f0-dbed800e3653-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Acquiring lock "cinder-quobyte-073ecb24-6c81-416d-89f0-dbed800e3653" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Lock "cinder-quobyte-073ecb24-6c81-416d-89f0-dbed800e3653" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:12 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[97836256-7807-41eb-8291-c254b272c62a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:13 devstack sudo[102967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653
Nov 03 08:14:13 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:13 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653" returned: 0 in 0.542s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:13 devstack sudo[102972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653
Nov 03 08:14:13 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:13 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-073ecb24-6c81-416d-89f0-dbed800e3653" returned: 0 in 0.309s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Lock "cinder-quobyte-073ecb24-6c81-416d-89f0-dbed800e3653" released by "delete_volume" :: held 0.919s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:13 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Created reservations ['2716b756-4014-4302-82ed-955c97cbb9ad', '3bc5d6d7-22b6-41dc-8e9a-733e921dccdd', '3a0bfe50-8e7b-4baa-af09-0f8c8c63da88', '5586d2d8-9d3f-42bc-8eb0-714c4a97586c'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:14:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:14:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:14:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:14 devstack sudo[102976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:14:14 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:14 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.343s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:14 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:14:14 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Deleted volume successfully.
Nov 03 08:14:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b431a76-9b68-4b48-95f4-35cdd0a2e96a tempest-TestMinimumBasicScenario-196453450 None] Lock "cinder-073ecb24-6c81-416d-89f0-dbed800e3653-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:16 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img" returned: 0 in 7.366s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:16 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[44614b98-eaea-4baa-9a34-4b6d2445c99d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:16 devstack sudo[103001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47
Nov 03 08:14:16 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:17 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47" returned: 0 in 0.560s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47, size 1024.00 MB, duration 7.37 sec, destination /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:14:17 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Converted 1024.00 MB image at 139.01 MB/s
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] 10a2d54f-9e76-486d-9743-8fa1e52d3723 was raw, converting to qcow2 {{(pid=86851) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[997fb490-51f9-41b6-9e83-d7a24fd9ce8d]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:17 devstack sudo[103007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img
Nov 03 08:14:17 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:17 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img" returned: 0 in 0.322s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:17 devstack sudo[103011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img
Nov 03 08:14:17 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:17 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img" returned: 1 in 0.321s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img /opt/stack/data/cinder/conversion/vol_upload_pu0jkbpk {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:17 devstack sudo[103016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img /opt/stack/data/cinder/conversion/vol_upload_pu0jkbpk
Nov 03 08:14:17 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:17 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img /opt/stack/data/cinder/conversion/vol_upload_pu0jkbpk" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Image conversion details: src /opt/stack/data/cinder/conversion/d78e779f-7567-44fc-a559-553b28540b47.temp_image.10a2d54f-9e76-486d-9743-8fa1e52d3723ripmyxjj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pu0jkbpk {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:14:17 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[def4ebaa-ca9b-49f7-a0df-0036cca215c9]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pu0jkbpk {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:18 devstack sudo[103023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pu0jkbpk
Nov 03 08:14:18 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:18 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pu0jkbpk" returned: 0 in 0.351s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.343s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Uploaded volume to glance image-id: 10a2d54f-9e76-486d-9743-8fa1e52d3723. {{(pid=86851) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 08:14:19 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-dbbce732-9dd4-4be1-8576-a72bc61fea38 tempest-VolumesActionsTest-385096185 None] Copy volume to image completed successfully.
Nov 03 08:14:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Acquiring lock "cinder-d78e779f-7567-44fc-a559-553b28540b47-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Lock "cinder-d78e779f-7567-44fc-a559-553b28540b47-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Acquiring lock "cinder-quobyte-d78e779f-7567-44fc-a559-553b28540b47" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Lock "cinder-quobyte-d78e779f-7567-44fc-a559-553b28540b47" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:20 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcd5c3b-4dd6-4da4-b07a-0b62f2d8ff4f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:20 devstack sudo[103036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47
Nov 03 08:14:20 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:20 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47" returned: 0 in 0.423s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:20 devstack sudo[103042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47
Nov 03 08:14:20 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:21 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d78e779f-7567-44fc-a559-553b28540b47" returned: 0 in 0.248s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Lock "cinder-quobyte-d78e779f-7567-44fc-a559-553b28540b47" released by "delete_volume" :: held 0.718s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Created reservations ['123089ae-34d3-47f8-b48e-bce23b26ba10', '1f0ac994-e61d-4aa0-952c-3fa409fef2a6', '4f2fb732-c32c-47f9-9c8a-2cd9ab735d9c', '0ac0b296-4313-4769-a4e2-797bb76a7345'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:21 devstack sudo[103046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:14:21 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:21 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.278s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:14:21 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Deleted volume successfully.
Nov 03 08:14:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4396724e-5554-4086-a410-d4e1431192c9 tempest-VolumesActionsTest-385096185 None] Lock "cinder-d78e779f-7567-44fc-a559-553b28540b47-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Flow 'volume_create_manager' (38c95f59-901b-4256-839e-d9547e9b7a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5d6a92-27a9-448f-a3ae-c0ac8b4a7c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5d6a92-27a9-448f-a3ae-c0ac8b4a7c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1752579127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02377818-9e06-4de7-aa8b-e7cb4fbfe94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8358b25f42ef4e0ebea94a31089772bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:29Z,use_quota=True,user_id='c44628cfed854d5abe8c81981baf63eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca45731-351a-4c5d-9fb0-47be75d1edb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca45731-351a-4c5d-9fb0-47be75d1edb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b7f11c-1378-4527-8f94-34fe606e04e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.image.glance [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Creating Keystone auth plugin from conf {{(pid=86851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b7f11c-1378-4527-8f94-34fe606e04e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02377818-9e06-4de7-aa8b-e7cb4fbfe94e', 'volume_name': 'volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d46652829c0>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97475857-f9e4-4582-a2ab-71791b953766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97475857-f9e4-4582-a2ab-71791b953766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8845313c-0326-4493-a331-605399214200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:29 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Volume 02377818-9e06-4de7-aa8b-e7cb4fbfe94e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d46652829c0>}
Nov 03 08:14:29 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Trying to clone 02377818-9e06-4de7-aa8b-e7cb4fbfe94e from image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]). {{(pid=86851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 08:14:30 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 08:14:30 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 08:14:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[822f3d69-e855-4256-a166-e643ecf7ef2c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:30 devstack sudo[103058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD
Nov 03 08:14:30 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:30 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:30 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Temporary image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 is fetched for user c44628cfed854d5abe8c81981baf63eb. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 08:14:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d70f814-6d44-4a94-9939-1c38ecbb47c6]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:30 devstack sudo[103063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD
Nov 03 08:14:30 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:30 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1752579127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02377818-9e06-4de7-aa8b-e7cb4fbfe94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8358b25f42ef4e0ebea94a31089772bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:29Z,use_quota=True,user_id='c44628cfed854d5abe8c81981baf63eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Creating volume 02377818-9e06-4de7-aa8b-e7cb4fbfe94e {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:14:31 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:31 devstack sudo[103068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e 1073741824
Nov 03 08:14:31 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:31 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e 1073741824" returned: 0 in 0.471s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:31 devstack sudo[103074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e
Nov 03 08:14:31 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:31 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e" returned: 0 in 0.249s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Attempting download of 8b203cae-6577-47a3-bc8a-1235a08ecbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}])) to volume 02377818-9e06-4de7-aa8b-e7cb4fbfe94e. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7081b806-9c44-4513-b461-a18e5797c261]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_59k5wkxk {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:31 devstack sudo[103077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_59k5wkxk
Nov 03 08:14:31 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:32 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_59k5wkxk" returned: 0 in 0.365s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_59k5wkxk {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:32 devstack sudo[103081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_59k5wkxk
Nov 03 08:14:32 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:32 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_59k5wkxk" returned: 1 in 0.349s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_59k5wkxk' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:14:32 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4667b9a-da85-4048-9f9f-97fe3cc83708]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:32 devstack sudo[103085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD
Nov 03 08:14:32 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:32 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:32 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] 8b203cae-6577-47a3-bc8a-1235a08ecbe1 was qcow2, converting to qcow2 {{(pid=86851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 08:14:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:32 devstack sudo[103090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e
Nov 03 08:14:32 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:34 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e" returned: 0 in 1.968s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:34 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_vjbijbpmdevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:14:34 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Converted 112.00 MB image at 56.89 MB/s
Nov 03 08:14:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:34 devstack sudo[103099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e 1G
Nov 03 08:14:34 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:35 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e 1G" returned: 0 in 0.332s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:35 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Downloaded image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}])) to volume 02377818-9e06-4de7-aa8b-e7cb4fbfe94e successfully. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 08:14:35 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Temporary image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 for user c44628cfed854d5abe8c81981baf63eb is deleted. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 08:14:35 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Marking volume 02377818-9e06-4de7-aa8b-e7cb4fbfe94e as bootable. {{(pid=86851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 08:14:35 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Copying metadata from image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 to 02377818-9e06-4de7-aa8b-e7cb4fbfe94e. {{(pid=86851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 08:14:35 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Creating volume glance metadata for volume 02377818-9e06-4de7-aa8b-e7cb4fbfe94e backed by image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 08:14:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8845313c-0326-4493-a331-605399214200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d46652829c0>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c325bf8-eb1c-45e6-a844-b0f64a75c40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:35 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Volume volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e (02377818-9e06-4de7-aa8b-e7cb4fbfe94e): created successfully
Nov 03 08:14:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c325bf8-eb1c-45e6-a844-b0f64a75c40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:35 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Flow 'volume_create_manager' (38c95f59-901b-4256-839e-d9547e9b7a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:14:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3de6d40a-458c-44a3-9bc2-1997b7f79c4b tempest-VolumesExtendTest-1772547571 None] Created volume successfully.
Nov 03 08:14:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-702c0794-2d5f-4d2a-86af-8f71906207c3 tempest-VolumesExtendTest-1772547571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-702c0794-2d5f-4d2a-86af-8f71906207c3 tempest-VolumesExtendTest-1772547571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:36 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8426365-7fd7-4533-af5a-c1f1a763ae79]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-702c0794-2d5f-4d2a-86af-8f71906207c3 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:36 devstack sudo[103141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e
Nov 03 08:14:36 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:36 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-702c0794-2d5f-4d2a-86af-8f71906207c3 tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e" returned: 0 in 0.439s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-702c0794-2d5f-4d2a-86af-8f71906207c3 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e 2G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-702c0794-2d5f-4d2a-86af-8f71906207c3 tempest-VolumesExtendTest-1772547571 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e 2G" returned: 0 in 0.104s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-702c0794-2d5f-4d2a-86af-8f71906207c3 tempest-VolumesExtendTest-1772547571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.592s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:36 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-702c0794-2d5f-4d2a-86af-8f71906207c3 tempest-VolumesExtendTest-1772547571 None] Extend volume completed successfully.
Nov 03 08:14:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Acquiring lock "cinder-02377818-9e06-4de7-aa8b-e7cb4fbfe94e-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Lock "cinder-02377818-9e06-4de7-aa8b-e7cb4fbfe94e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Acquiring lock "cinder-quobyte-02377818-9e06-4de7-aa8b-e7cb4fbfe94e" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Lock "cinder-quobyte-02377818-9e06-4de7-aa8b-e7cb4fbfe94e" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:37 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bce2c49-ab57-4223-9c66-4019656dba25]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:37 devstack sudo[103150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e
Nov 03 08:14:37 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:38 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e" returned: 0 in 0.409s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:38 devstack sudo[103155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e
Nov 03 08:14:38 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:38 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-02377818-9e06-4de7-aa8b-e7cb4fbfe94e" returned: 0 in 0.279s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Lock "cinder-quobyte-02377818-9e06-4de7-aa8b-e7cb4fbfe94e" released by "delete_volume" :: held 0.732s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Created reservations ['ad04dd99-c90e-41a4-8132-e2584a6bb8e2', '2ad4781c-b715-408c-8d43-e87488f9c166', '3bd490d2-24ba-4eec-90f6-284bc35f2556', 'f7bbe0d1-4bc3-4a46-af6f-aeb475876dfc'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:38 devstack sudo[103158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:14:38 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:38 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.258s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:14:38 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Deleted volume successfully.
Nov 03 08:14:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e043df66-c3f7-426a-a08d-23e0c197338d tempest-VolumesExtendTest-1772547571 None] Lock "cinder-02377818-9e06-4de7-aa8b-e7cb4fbfe94e-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Flow 'volume_create_manager' (8457cfc5-4dee-4210-bab4-2c1b6dc7994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b55fc4-3dde-43aa-aa59-4d7d0e685e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b55fc4-3dde-43aa-aa59-4d7d0e685e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-789329762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc71725-8baf-42a9-874b-7f6d599752fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8358b25f42ef4e0ebea94a31089772bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:39Z,use_quota=True,user_id='c44628cfed854d5abe8c81981baf63eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf2e101-fdc7-4f6c-882b-9011fe988938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf2e101-fdc7-4f6c-882b-9011fe988938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2672469-8d25-4a44-aae3-8f60f3ac2040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2672469-8d25-4a44-aae3-8f60f3ac2040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc71725-8baf-42a9-874b-7f6d599752fb', 'volume_name': 'volume-0fc71725-8baf-42a9-874b-7f6d599752fb', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e016e7e1-63d6-4f6c-af22-faeb56d11382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e016e7e1-63d6-4f6c-af22-faeb56d11382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841ba163-430c-4a9f-a45f-009daa9e4366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:39 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Volume 0fc71725-8baf-42a9-874b-7f6d599752fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc71725-8baf-42a9-874b-7f6d599752fb', 'volume_size': 1}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-789329762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc71725-8baf-42a9-874b-7f6d599752fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8358b25f42ef4e0ebea94a31089772bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:39Z,use_quota=True,user_id='c44628cfed854d5abe8c81981baf63eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Creating volume 0fc71725-8baf-42a9-874b-7f6d599752fb {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:14:39 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:39 devstack sudo[103161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb 1073741824
Nov 03 08:14:39 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:39 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb 1073741824" returned: 0 in 0.455s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:39 devstack sudo[103166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb
Nov 03 08:14:39 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:40 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841ba163-430c-4a9f-a45f-009daa9e4366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc71725-8baf-42a9-874b-7f6d599752fb', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ec353f-5c8d-48fa-acca-21a4acc217f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:40 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Volume volume-0fc71725-8baf-42a9-874b-7f6d599752fb (0fc71725-8baf-42a9-874b-7f6d599752fb): created successfully
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ec353f-5c8d-48fa-acca-21a4acc217f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Flow 'volume_create_manager' (8457cfc5-4dee-4210-bab4-2c1b6dc7994e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:14:40 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d50e10f9-a39d-47f3-bd45-fae1d74f1df7 tempest-VolumesExtendTest-1772547571 None] Created volume successfully.
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Creating offline snapshot cdd96388-0244-47e8-b32b-a6e0785c3b2e of volume 0fc71725-8baf-42a9-874b-7f6d599752fb {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f22139f-91e5-44bf-8484-6ee257fa1d5c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:40 devstack sudo[103170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb
Nov 03 08:14:40 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:41 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb" returned: 0 in 0.480s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:41 devstack sudo[103175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e 1G
Nov 03 08:14:41 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:41 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e 1G" returned: 0 in 0.418s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fc71725-8baf-42a9-874b-7f6d599752fb -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:41 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fc71725-8baf-42a9-874b-7f6d599752fb -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e
Nov 03 08:14:41 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:41 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fc71725-8baf-42a9-874b-7f6d599752fb -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e" returned: 0 in 0.302s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:41 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e is being set with open permissions: ugo+rw
Nov 03 08:14:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:41 devstack sudo[103186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e
Nov 03 08:14:41 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:42 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e" returned: 0 in 0.271s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:42 devstack sudo[103189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.info
Nov 03 08:14:42 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:42 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.info" returned: 0 in 0.283s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:42 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.info is being set with open permissions: ugo+rw
Nov 03 08:14:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:42 devstack sudo[103192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.info
Nov 03 08:14:42 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:42 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.info" returned: 0 in 0.259s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:42 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-777ce4de-c91c-4576-b25a-ae32de1fecb6 tempest-VolumesExtendTest-1772547571 None] Create snapshot completed successfully
Nov 03 08:14:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b4936258-6915-47c3-9fec-1de3216d5da2 tempest-VolumesExtendTest-1772547571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b4936258-6915-47c3-9fec-1de3216d5da2 tempest-VolumesExtendTest-1772547571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:43 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[195d9297-7590-4f3d-bba4-0a1aea027ded]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b4936258-6915-47c3-9fec-1de3216d5da2 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:43 devstack sudo[103196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb
Nov 03 08:14:43 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:44 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b4936258-6915-47c3-9fec-1de3216d5da2 tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb" returned: 0 in 0.370s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b4936258-6915-47c3-9fec-1de3216d5da2 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e 2G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b4936258-6915-47c3-9fec-1de3216d5da2 tempest-VolumesExtendTest-1772547571 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e 2G" returned: 0 in 0.141s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b4936258-6915-47c3-9fec-1de3216d5da2 tempest-VolumesExtendTest-1772547571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.558s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:44 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b4936258-6915-47c3-9fec-1de3216d5da2 tempest-VolumesExtendTest-1772547571 None] Extend volume completed successfully.
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Acquiring lock "cinder-cdd96388-0244-47e8-b32b-a6e0785c3b2e-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Lock "cinder-cdd96388-0244-47e8-b32b-a6e0785c3b2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Acquiring lock "cinder-quobyte-0fc71725-8baf-42a9-874b-7f6d599752fb" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Lock "cinder-quobyte-0fc71725-8baf-42a9-874b-7f6d599752fb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Acquiring lock "cinder-quobyte-cdd96388-0244-47e8-b32b-a6e0785c3b2e" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Lock "cinder-quobyte-cdd96388-0244-47e8-b32b-a6e0785c3b2e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Deleting offline snapshot cdd96388-0244-47e8-b32b-a6e0785c3b2e of volume 0fc71725-8baf-42a9-874b-7f6d599752fb {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] snapshot_file for this snap is: volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[52045ada-9f92-488a-b328-b16f1d77187d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:45 devstack sudo[103204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e
Nov 03 08:14:45 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:45 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e" returned: 0 in 0.358s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fc71725-8baf-42a9-874b-7f6d599752fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5396562b-a11c-4e65-992e-ac774d423801]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:45 devstack sudo[103210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb
Nov 03 08:14:45 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:46 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb" returned: 0 in 0.491s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:46 devstack sudo[103215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e
Nov 03 08:14:46 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:46 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e" returned: 0 in 0.443s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:46 devstack sudo[103222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e
Nov 03 08:14:46 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:46 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb.cdd96388-0244-47e8-b32b-a6e0785c3b2e" returned: 0 in 0.276s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Lock "cinder-quobyte-cdd96388-0244-47e8-b32b-a6e0785c3b2e" released by "_delete_snapshot" :: held 1.697s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Lock "cinder-quobyte-0fc71725-8baf-42a9-874b-7f6d599752fb" released by "delete_snapshot" :: held 1.724s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:46 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Created reservations ['0bb5ae64-2e30-43f4-bd9f-96ecc515595d', '43b437e7-5193-4c52-bba5-8e7634eb5906', '29780ed2-2671-4122-a405-d5d8b9ee2aac', 'c6e62bf8-11c1-4598-97ba-b2611167cc41'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:14:47 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Delete snapshot completed successfully.
Nov 03 08:14:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5164681-0ec3-4f7e-95e8-39071d2dc1f2 tempest-VolumesExtendTest-1772547571 None] Lock "cinder-cdd96388-0244-47e8-b32b-a6e0785c3b2e-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Acquiring lock "cinder-0fc71725-8baf-42a9-874b-7f6d599752fb-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Lock "cinder-0fc71725-8baf-42a9-874b-7f6d599752fb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Acquiring lock "cinder-quobyte-0fc71725-8baf-42a9-874b-7f6d599752fb" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:14:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Lock "cinder-quobyte-0fc71725-8baf-42a9-874b-7f6d599752fb" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:14:47 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8edd20c-1b63-479d-a405-9b5c7c9d875f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:47 devstack sudo[103225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb
Nov 03 08:14:47 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:47 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb" returned: 0 in 0.410s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:47 devstack sudo[103230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb
Nov 03 08:14:47 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:48 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0fc71725-8baf-42a9-874b-7f6d599752fb" returned: 0 in 0.282s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Lock "cinder-quobyte-0fc71725-8baf-42a9-874b-7f6d599752fb" released by "delete_volume" :: held 0.777s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Created reservations ['62e678b0-a998-476f-be4f-f8a111857eeb', 'e1392204-9711-4e39-96d6-c99947d5f089', '10f08e48-084a-46ca-83cd-c174ea0fe589', '126a95f1-3b5f-4c7a-953c-6a7ce488af6f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:48 devstack sudo[103233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:14:48 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:48 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.315s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:14:48 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Deleted volume successfully.
Nov 03 08:14:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3ac187ac-37a5-4ffd-ac48-42beb7676b9a tempest-VolumesExtendTest-1772547571 None] Lock "cinder-0fc71725-8baf-42a9-874b-7f6d599752fb-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Flow 'volume_create_manager' (4bad08d0-463d-46c3-abec-04874ca8a06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f462e158-0427-4d34-9d68-1436225ad28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f462e158-0427-4d34-9d68-1436225ad28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-344138998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b48d7c-1863-449a-96e3-c65d5cc3976e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a382382536f48d0b507988ba0e606fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:54Z,use_quota=True,user_id='a0672ddc7e5548388d77410986b1da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7dba928-3f88-4581-a2cd-35738ab20cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7dba928-3f88-4581-a2cd-35738ab20cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3754fc4-ebb2-431b-8d4a-3d681fcdd9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.image.glance [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Creating Keystone auth plugin from conf {{(pid=86851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3754fc4-ebb2-431b-8d4a-3d681fcdd9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79b48d7c-1863-449a-96e3-c65d5cc3976e', 'volume_name': 'volume-79b48d7c-1863-449a-96e3-c65d5cc3976e', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d46652569c0>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a03a8d4-b4fa-4a03-ab10-744158b410d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a03a8d4-b4fa-4a03-ab10-744158b410d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6b1437-2f5c-4302-84a7-1723b9723f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:53 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Volume 79b48d7c-1863-449a-96e3-c65d5cc3976e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79b48d7c-1863-449a-96e3-c65d5cc3976e', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d46652569c0>}
Nov 03 08:14:53 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Trying to clone 79b48d7c-1863-449a-96e3-c65d5cc3976e from image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]). {{(pid=86851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 08:14:54 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 08:14:54 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 08:14:54 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3378260d-3ac0-4899-963e-b05fb8ca0198]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:54 devstack sudo[103238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD
Nov 03 08:14:54 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:54 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:54 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Temporary image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 is fetched for user a0672ddc7e5548388d77410986b1da2d. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 08:14:54 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d712598-9e04-4529-beeb-9c995c18ffc6]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:54 devstack sudo[103243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD
Nov 03 08:14:54 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:55 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-344138998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b48d7c-1863-449a-96e3-c65d5cc3976e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a382382536f48d0b507988ba0e606fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:54Z,use_quota=True,user_id='a0672ddc7e5548388d77410986b1da2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Creating volume 79b48d7c-1863-449a-96e3-c65d5cc3976e {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:14:55 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:55 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e 1073741824
Nov 03 08:14:55 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:55 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e 1073741824" returned: 0 in 0.465s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:55 devstack sudo[103254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e
Nov 03 08:14:55 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:55 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e" returned: 0 in 0.252s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Attempting download of 8b203cae-6577-47a3-bc8a-1235a08ecbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}])) to volume 79b48d7c-1863-449a-96e3-c65d5cc3976e. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58dc471-d7d6-4981-9855-a3ddb00e5404]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_ib98dy7o {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:56 devstack sudo[103257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_ib98dy7o
Nov 03 08:14:56 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Flow 'volume_create_manager' (57dbe9a4-f361-4d77-a0a1-5213d74b8e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f44a14f-9a55-4618-a0c8-759dc1b67ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f44a14f-9a55-4618-a0c8-759dc1b67ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-642292724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf61cca-a15f-478a-9fd4-87f0fed60781,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81ae2437fae647289e3c8bd69a2569ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:56Z,use_quota=True,user_id='dd7e520c2ac34f928d305c08ad849924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a90fdf-ac3b-4af9-9dc5-abe99f0d1a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a90fdf-ac3b-4af9-9dc5-abe99f0d1a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87090a4e-4434-4947-84e7-f9233d3b98f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87090a4e-4434-4947-84e7-f9233d3b98f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf61cca-a15f-478a-9fd4-87f0fed60781', 'volume_name': 'volume-ccf61cca-a15f-478a-9fd4-87f0fed60781', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff09dce-4469-4387-a5e6-f3bda7f6fa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff09dce-4469-4387-a5e6-f3bda7f6fa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5fae0e-7132-4c9e-adbb-acecc10f925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:56 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Volume ccf61cca-a15f-478a-9fd4-87f0fed60781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf61cca-a15f-478a-9fd4-87f0fed60781', 'volume_size': 1}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-642292724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf61cca-a15f-478a-9fd4-87f0fed60781,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81ae2437fae647289e3c8bd69a2569ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:56Z,use_quota=True,user_id='dd7e520c2ac34f928d305c08ad849924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Creating volume ccf61cca-a15f-478a-9fd4-87f0fed60781 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:14:56 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:56 devstack sudo[103259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781 1073741824
Nov 03 08:14:56 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:56 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_ib98dy7o" returned: 0 in 0.354s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_ib98dy7o {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:56 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_ib98dy7o
Nov 03 08:14:56 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:56 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_ib98dy7o" returned: 1 in 0.341s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b203cae-6577-47a3-bc8a-1235a08ecbe1_ib98dy7o' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[961628fd-d501-4524-ba9b-31b3f15d967e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:56 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781 1073741824" returned: 0 in 0.432s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:56 devstack sudo[103271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781
Nov 03 08:14:56 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:56 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD
Nov 03 08:14:56 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:56 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781" returned: 0 in 0.255s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:57 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5fae0e-7132-4c9e-adbb-acecc10f925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf61cca-a15f-478a-9fd4-87f0fed60781', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6188023-68e5-457e-a0b9-ff75342b575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] 8b203cae-6577-47a3-bc8a-1235a08ecbe1 was qcow2, converting to qcow2 {{(pid=86851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:57 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Volume volume-ccf61cca-a15f-478a-9fd4-87f0fed60781 (ccf61cca-a15f-478a-9fd4-87f0fed60781): created successfully
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6188023-68e5-457e-a0b9-ff75342b575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:57 devstack sudo[103278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e
Nov 03 08:14:57 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Flow 'volume_create_manager' (57dbe9a4-f361-4d77-a0a1-5213d74b8e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:14:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9f5634a8-1abd-4288-8262-c4ef92198635 tempest-VolumesListTestJSON-1094033890 None] Created volume successfully.
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Flow 'volume_create_manager' (aa016ace-f6c9-4f2d-9963-c9af1d0368ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f662469-481c-49d9-a445-27e538edc756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f662469-481c-49d9-a445-27e538edc756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-641603552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6450506d-890e-4ea0-b2aa-4b58c1364258,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81ae2437fae647289e3c8bd69a2569ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:58Z,use_quota=True,user_id='dd7e520c2ac34f928d305c08ad849924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0755a83-23f3-4db7-a15e-2457c0ebdabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0755a83-23f3-4db7-a15e-2457c0ebdabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cde4735-46c0-4375-b77d-d74c36d11b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cde4735-46c0-4375-b77d-d74c36d11b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6450506d-890e-4ea0-b2aa-4b58c1364258', 'volume_name': 'volume-6450506d-890e-4ea0-b2aa-4b58c1364258', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049c2516-a6f5-40a6-b8d6-5283496a64f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049c2516-a6f5-40a6-b8d6-5283496a64f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4c5f9b-aedc-4181-9c63-c7a65991a567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:57 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Volume 6450506d-890e-4ea0-b2aa-4b58c1364258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6450506d-890e-4ea0-b2aa-4b58c1364258', 'volume_size': 1}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-641603552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6450506d-890e-4ea0-b2aa-4b58c1364258,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81ae2437fae647289e3c8bd69a2569ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:58Z,use_quota=True,user_id='dd7e520c2ac34f928d305c08ad849924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Creating volume 6450506d-890e-4ea0-b2aa-4b58c1364258 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:14:57 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:14:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:57 devstack sudo[103287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258 1073741824
Nov 03 08:14:57 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:58 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258 1073741824" returned: 0 in 0.520s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=61,cinder:SELECT=54,cinder:INSERT=19,cinder:DELETE=4 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=53,cinder:INSERT=20,cinder:UPDATE=57,cinder:DELETE=4 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:58 devstack sudo[103293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258
Nov 03 08:14:58 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:58 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258" returned: 0 in 0.294s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4c5f9b-aedc-4181-9c63-c7a65991a567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6450506d-890e-4ea0-b2aa-4b58c1364258', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2579c0-d30e-447d-911f-ed3f6ee45518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:58 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Volume volume-6450506d-890e-4ea0-b2aa-4b58c1364258 (6450506d-890e-4ea0-b2aa-4b58c1364258): created successfully
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2579c0-d30e-447d-911f-ed3f6ee45518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Flow 'volume_create_manager' (aa016ace-f6c9-4f2d-9963-c9af1d0368ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:14:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7f852a76-7439-41b5-83ff-e2ceb06fbc8d tempest-VolumesListTestJSON-1094033890 None] Created volume successfully.
Nov 03 08:14:58 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e" returned: 0 in 1.937s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b203cae-6577-47a3-bc8a-1235a08ecbe1_zkxxrg9fdevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:14:58 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Converted 112.00 MB image at 57.80 MB/s
Nov 03 08:14:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:14:59 devstack sudo[103296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e 1G
Nov 03 08:14:59 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:14:59 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root
Nov 03 08:14:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e 1G" returned: 0 in 0.308s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:14:59 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Downloaded image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}])) to volume 79b48d7c-1863-449a-96e3-c65d5cc3976e successfully. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 08:14:59 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Temporary image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 for user a0672ddc7e5548388d77410986b1da2d is deleted. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 08:14:59 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Marking volume 79b48d7c-1863-449a-96e3-c65d5cc3976e as bootable. {{(pid=86851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 08:14:59 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Copying metadata from image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 to 79b48d7c-1863-449a-96e3-c65d5cc3976e. {{(pid=86851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 08:14:59 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Creating volume glance metadata for volume 79b48d7c-1863-449a-96e3-c65d5cc3976e backed by image 8b203cae-6577-47a3-bc8a-1235a08ecbe1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 08:14:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6b1437-2f5c-4302-84a7-1723b9723f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b48d7c-1863-449a-96e3-c65d5cc3976e', 'volume_size': 1, 'image_id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37f9d1889d744a689819aa6e4fc75127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b203cae-6577-47a3-bc8a-1235a08ecbe1', 'created_at': datetime.datetime(2026, 11, 3, 6, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 6, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b203cae-6577-47a3-bc8a-1235a08ecbe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d46652569c0>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9196f6-7e31-4084-8294-3b1123ded3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:14:59 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Volume volume-79b48d7c-1863-449a-96e3-c65d5cc3976e (79b48d7c-1863-449a-96e3-c65d5cc3976e): created successfully
Nov 03 08:14:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9196f6-7e31-4084-8294-3b1123ded3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:14:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Flow 'volume_create_manager' (4bad08d0-463d-46c3-abec-04874ca8a06e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:14:59 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c042b67b-10ca-4781-9ac3-9ba18195f519 tempest-TestShelveInstance-916800310 None] Created volume successfully.
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Flow 'volume_create_manager' (0cb7c5db-182d-409c-99a7-edc8bb0c5960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ee5e32-dc7e-4d01-a326-59d7734fd2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ee5e32-dc7e-4d01-a326-59d7734fd2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-204484888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c798853c-6fbe-498e-8969-29af020d76d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81ae2437fae647289e3c8bd69a2569ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:15:00Z,use_quota=True,user_id='dd7e520c2ac34f928d305c08ad849924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67837a9-5917-4b18-adfc-9dda434e0080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67837a9-5917-4b18-adfc-9dda434e0080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2388070d-9217-42c7-a191-f993036f1147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2388070d-9217-42c7-a191-f993036f1147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c798853c-6fbe-498e-8969-29af020d76d2', 'volume_name': 'volume-c798853c-6fbe-498e-8969-29af020d76d2', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396aaebd-ec65-4908-bb24-843de1ef9f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396aaebd-ec65-4908-bb24-843de1ef9f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a478c8a-e051-4aa1-a654-bcd8d22b9cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:00 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Volume c798853c-6fbe-498e-8969-29af020d76d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c798853c-6fbe-498e-8969-29af020d76d2', 'volume_size': 1}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-204484888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c798853c-6fbe-498e-8969-29af020d76d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81ae2437fae647289e3c8bd69a2569ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:15:00Z,use_quota=True,user_id='dd7e520c2ac34f928d305c08ad849924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Creating volume c798853c-6fbe-498e-8969-29af020d76d2 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:15:00 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:00 devstack sudo[103301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2 1073741824
Nov 03 08:15:00 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:00 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2 1073741824" returned: 0 in 0.490s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:00 devstack sudo[103310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2
Nov 03 08:15:00 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:01 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2" returned: 0 in 0.269s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:15:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a478c8a-e051-4aa1-a654-bcd8d22b9cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c798853c-6fbe-498e-8969-29af020d76d2', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d085b302-4978-4333-a4ab-e3f9fa1eafc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:01 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Volume volume-c798853c-6fbe-498e-8969-29af020d76d2 (c798853c-6fbe-498e-8969-29af020d76d2): created successfully
Nov 03 08:15:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d085b302-4978-4333-a4ab-e3f9fa1eafc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Flow 'volume_create_manager' (0cb7c5db-182d-409c-99a7-edc8bb0c5960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:15:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e2cec480-4bce-4419-b632-8a9d3be0199f tempest-VolumesListTestJSON-1094033890 None] Created volume successfully.
Nov 03 08:15:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-14558fb2-538b-4477-a053-01e0f4892e46 req-87c92fe4-95f2-4298-83f6-d28f42a06448 tempest-TestShelveInstance-916800310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-14558fb2-538b-4477-a053-01e0f4892e46 req-87c92fe4-95f2-4298-83f6-d28f42a06448 tempest-TestShelveInstance-916800310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-14558fb2-538b-4477-a053-01e0f4892e46 req-87c92fe4-95f2-4298-83f6-d28f42a06448 tempest-TestShelveInstance-916800310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-14558fb2-538b-4477-a053-01e0f4892e46 req-87c92fe4-95f2-4298-83f6-d28f42a06448 tempest-TestShelveInstance-916800310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-79b48d7c-1863-449a-96e3-c65d5cc3976e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '600b59ad-3d28-427a-85bc-49f249ba7861', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:15:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-14558fb2-538b-4477-a053-01e0f4892e46 req-87c92fe4-95f2-4298-83f6-d28f42a06448 tempest-TestShelveInstance-916800310 None] attachment_update completed successfully.
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:03 devstack sudo[103324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:15:03 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:03 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.311s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:15:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:15:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "cinder-c798853c-6fbe-498e-8969-29af020d76d2-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-c798853c-6fbe-498e-8969-29af020d76d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "cinder-quobyte-c798853c-6fbe-498e-8969-29af020d76d2" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-quobyte-c798853c-6fbe-498e-8969-29af020d76d2" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:04 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bba271-91a1-4281-a76c-1c79978177ea]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:04 devstack sudo[103407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2
Nov 03 08:15:04 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:05 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2" returned: 0 in 0.525s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:05 devstack sudo[103667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2
Nov 03 08:15:05 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:05 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c798853c-6fbe-498e-8969-29af020d76d2" returned: 0 in 0.376s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-quobyte-c798853c-6fbe-498e-8969-29af020d76d2" released by "delete_volume" :: held 0.965s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Created reservations ['e9e73e44-193a-4727-bc76-1e2a80183b90', '7e6e3469-00b8-457a-9b41-38908c575bc6', '30dba416-362a-46c4-9d3f-d6c57a472995', 'bb01becf-3dc8-4d88-90af-6cada48c8fea'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:06 devstack sudo[103812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:15:06 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:06 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.306s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:06 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:15:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Deleted volume successfully.
Nov 03 08:15:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-88d86ed8-7fd8-4528-a4b9-5d5a0b8a74e4 tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-c798853c-6fbe-498e-8969-29af020d76d2-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "cinder-6450506d-890e-4ea0-b2aa-4b58c1364258-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-6450506d-890e-4ea0-b2aa-4b58c1364258-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "cinder-quobyte-6450506d-890e-4ea0-b2aa-4b58c1364258" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-quobyte-6450506d-890e-4ea0-b2aa-4b58c1364258" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:07 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[713465df-9c08-4720-b396-0aa448da4c33]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:07 devstack sudo[103820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258
Nov 03 08:15:07 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:07 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258" returned: 0 in 0.419s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:07 devstack sudo[103825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258
Nov 03 08:15:07 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:07 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6450506d-890e-4ea0-b2aa-4b58c1364258" returned: 0 in 0.280s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-quobyte-6450506d-890e-4ea0-b2aa-4b58c1364258" released by "delete_volume" :: held 0.755s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Created reservations ['1bb8ace6-dab2-4bad-9f5d-517f3a53f1b0', 'a9bce71a-ded6-4ce9-94b5-fa0491e00fa5', 'e2eedce4-74fe-481b-884b-a0f3d48bafa3', '623200bb-ffa0-454a-8ef5-4238fb32ff31'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:08 devstack sudo[103828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:15:08 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:08 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.287s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:15:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Deleted volume successfully.
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "cinder-ccf61cca-a15f-478a-9fd4-87f0fed60781-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7818b62f-ca99-43bc-8f62-f8d592618d1d tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-6450506d-890e-4ea0-b2aa-4b58c1364258-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-ccf61cca-a15f-478a-9fd4-87f0fed60781-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "cinder-quobyte-ccf61cca-a15f-478a-9fd4-87f0fed60781" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-quobyte-ccf61cca-a15f-478a-9fd4-87f0fed60781" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9505ae-7b96-4b29-89b3-87f36c1761d4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:08 devstack sudo[103831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781
Nov 03 08:15:08 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:09 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781" returned: 0 in 0.437s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:09 devstack sudo[103836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781
Nov 03 08:15:09 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:09 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ccf61cca-a15f-478a-9fd4-87f0fed60781" returned: 0 in 0.310s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-quobyte-ccf61cca-a15f-478a-9fd4-87f0fed60781" released by "delete_volume" :: held 0.804s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Created reservations ['0d6eacde-66d9-4af4-8f1f-2c35c002dfdd', '1d5f5d8d-6b11-402b-8ca4-7a93e3bd5443', 'c049a50e-6866-4017-8443-006dd662daad', '00c9ae94-d61b-43b7-8552-13fa972ed146'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:09 devstack sudo[103840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:15:09 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:09 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.319s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:15:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Deleted volume successfully.
Nov 03 08:15:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fe371489-ed14-4580-ae09-c43122c79794 tempest-VolumesListTestJSON-1094033890 None] Lock "cinder-ccf61cca-a15f-478a-9fd4-87f0fed60781-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Flow 'volume_create_manager' (26882a2b-0c06-4c3e-8b8f-83edc2335862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466ca4a1-9fb6-4079-add8-e09f328334b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466ca4a1-9fb6-4079-add8-e09f328334b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1846988606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60815ec-b43d-4cb7-a8cd-58c194c31bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ac55a8799a47a4bf316c33a234e336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:15:14Z,use_quota=True,user_id='1467ff01322047c6b9ee1f1e3b1aae96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eef107b-9570-42c4-95e0-c5b89dec1572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eef107b-9570-42c4-95e0-c5b89dec1572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cce6a5-e8b1-4864-a6fe-4f553f49621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cce6a5-e8b1-4864-a6fe-4f553f49621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b60815ec-b43d-4cb7-a8cd-58c194c31bed', 'volume_name': 'volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ebf918-2807-4527-b592-df499e251229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ebf918-2807-4527-b592-df499e251229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8211773e-a4d2-4c50-97fb-fa6b10e582aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Volume b60815ec-b43d-4cb7-a8cd-58c194c31bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed', 'volume_size': 1}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1846988606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60815ec-b43d-4cb7-a8cd-58c194c31bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ac55a8799a47a4bf316c33a234e336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:15:14Z,use_quota=True,user_id='1467ff01322047c6b9ee1f1e3b1aae96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Creating volume b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:15:13 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:15:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:13 devstack sudo[103846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed 1073741824
Nov 03 08:15:13 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:14 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed 1073741824" returned: 0 in 0.434s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:14 devstack sudo[103852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed
Nov 03 08:15:14 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:14 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed" returned: 0 in 0.243s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8211773e-a4d2-4c50-97fb-fa6b10e582aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf03a13-a877-4bfc-8137-58dfd54d9d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:15:14 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Volume volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed (b60815ec-b43d-4cb7-a8cd-58c194c31bed): created successfully
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf03a13-a877-4bfc-8137-58dfd54d9d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Flow 'volume_create_manager' (26882a2b-0c06-4c3e-8b8f-83edc2335862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:15:14 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-70e8fb86-4840-4268-aae6-0176b765c387 tempest-VolumesSnapshotListTestJSON-654294529 None] Created volume successfully.
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Creating offline snapshot 779a2255-2899-419b-9308-fd2592677c61 of volume b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e521814-4304-4b02-914a-27cac2ba288d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:15 devstack sudo[103855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed
Nov 03 08:15:15 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:15 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed" returned: 0 in 0.362s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:15 devstack sudo[103860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 1G
Nov 03 08:15:15 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:15 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 1G" returned: 0 in 0.395s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:15 devstack sudo[103866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61
Nov 03 08:15:15 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:16 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61" returned: 0 in 0.302s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:16 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 is being set with open permissions: ugo+rw
Nov 03 08:15:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:16 devstack sudo[103871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61
Nov 03 08:15:16 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:16 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61" returned: 0 in 0.258s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:16 devstack sudo[103874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.info
Nov 03 08:15:16 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:16 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.info" returned: 0 in 0.260s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:16 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.info is being set with open permissions: ugo+rw
Nov 03 08:15:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:16 devstack sudo[103877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.info
Nov 03 08:15:16 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:16 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.info" returned: 0 in 0.244s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:16 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-6859a759-9e7f-42f9-b669-c4f1024e8e11 tempest-VolumesSnapshotListTestJSON-654294529 None] Create snapshot completed successfully
Nov 03 08:15:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] Creating offline snapshot d613b282-56d6-422d-aa43-de74f3cf70da of volume b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:15:17 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3599af6a-34ee-43fd-963c-f72b53655aab]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:17 devstack sudo[103880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61
Nov 03 08:15:17 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:17 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61" returned: 0 in 0.373s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:15:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:17 devstack sudo[103885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da 1G
Nov 03 08:15:17 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:18 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da 1G" returned: 0 in 0.440s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:18 devstack sudo[103890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da
Nov 03 08:15:18 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:18 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da" returned: 0 in 0.379s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:18 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da is being set with open permissions: ugo+rw
Nov 03 08:15:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:18 devstack sudo[103903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da
Nov 03 08:15:18 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:18 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.555s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-08a7b005-92f4-4ed2-8963-0c377fe01d09 tempest-VolumesSnapshotListTestJSON-654294529 None] Create snapshot completed successfully
Nov 03 08:15:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] Creating offline snapshot 7a91bbdb-abb6-4ec7-bd02-2f759e163c87 of volume b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:15:19 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd12fbd-09f2-4dbe-9a84-aa3e187061f1]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:19 devstack sudo[103906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da
Nov 03 08:15:19 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:19 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da" returned: 0 in 0.358s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:15:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:19 devstack sudo[103911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87 1G
Nov 03 08:15:19 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:20 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87 1G" returned: 0 in 0.457s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:20 devstack sudo[103917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87
Nov 03 08:15:20 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:20 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87" returned: 0 in 0.307s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:20 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87 is being set with open permissions: ugo+rw
Nov 03 08:15:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:20 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87
Nov 03 08:15:20 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:20 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87" returned: 0 in 0.246s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.458s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:20 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-827847b2-155c-415b-8c83-c4cdaf94d5c0 tempest-VolumesSnapshotListTestJSON-654294529 None] Create snapshot completed successfully
Nov 03 08:15:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-7a91bbdb-abb6-4ec7-bd02-2f759e163c87-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-7a91bbdb-abb6-4ec7-bd02-2f759e163c87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-quobyte-7a91bbdb-abb6-4ec7-bd02-2f759e163c87" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-7a91bbdb-abb6-4ec7-bd02-2f759e163c87" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Deleting offline snapshot 7a91bbdb-abb6-4ec7-bd02-2f759e163c87 of volume b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:15:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] snapshot_file for this snap is: volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:15:22 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc83077-260e-4b7b-ae03-bc95e7acbf62]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:22 devstack sudo[103929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87
Nov 03 08:15:22 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:23 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87" returned: 0 in 0.408s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:15:23 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3bd1e7-9586-4deb-9b17-11dfc7567237]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:23 devstack sudo[103944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da
Nov 03 08:15:23 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:23 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da" returned: 0 in 0.377s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:15:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:23 devstack sudo[103949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87
Nov 03 08:15:23 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:23 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87" returned: 0 in 0.382s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:23 devstack sudo[103954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87
Nov 03 08:15:23 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:24 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.7a91bbdb-abb6-4ec7-bd02-2f759e163c87" returned: 0 in 0.243s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-7a91bbdb-abb6-4ec7-bd02-2f759e163c87" released by "_delete_snapshot" :: held 1.536s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" released by "delete_snapshot" :: held 1.557s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Created reservations ['ad327e6e-b4d7-48c9-a9e7-5c9db95b5139', 'de85c4a5-cbb0-452b-abe8-491d95ba5a60', 'f68b900b-f236-4b9b-a17b-b4aaf8dc3327', 'f4751c0d-40e3-4a40-b138-d76a2d6014ce'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:15:24 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Delete snapshot completed successfully.
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f3c760cd-92b9-46bb-9921-4b8abba6534b tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-7a91bbdb-abb6-4ec7-bd02-2f759e163c87-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-d613b282-56d6-422d-aa43-de74f3cf70da-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-d613b282-56d6-422d-aa43-de74f3cf70da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-quobyte-d613b282-56d6-422d-aa43-de74f3cf70da" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-d613b282-56d6-422d-aa43-de74f3cf70da" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Deleting offline snapshot d613b282-56d6-422d-aa43-de74f3cf70da of volume b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] snapshot_file for this snap is: volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1069fa0-d7e3-4f6c-9689-b247d65efebe]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:24 devstack sudo[103982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da
Nov 03 08:15:24 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:25 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da" returned: 0 in 0.346s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:15:25 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda629cb-4642-427c-86de-227a24f83179]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:25 devstack sudo[103987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61
Nov 03 08:15:25 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:25 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61" returned: 0 in 0.339s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:15:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:25 devstack sudo[103992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da
Nov 03 08:15:25 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:25 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da" returned: 0 in 0.351s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:25 devstack sudo[103998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da
Nov 03 08:15:25 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:26 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.d613b282-56d6-422d-aa43-de74f3cf70da" returned: 0 in 0.241s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-d613b282-56d6-422d-aa43-de74f3cf70da" released by "_delete_snapshot" :: held 1.385s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" released by "delete_snapshot" :: held 1.405s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Created reservations ['af6d39f3-948e-4415-8fd6-ab3580f3e51b', '80a78d0e-4d5a-45c3-a8f5-bac3f3808f58', 'cea6d6d4-b02f-429c-acdb-075e0cae6c5a', 'ab132e42-37b7-4bcd-a1d1-415fb38b1669'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:15:26 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Delete snapshot completed successfully.
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ca0cc26b-f0eb-4bcd-a7ea-7920aaed64aa tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-d613b282-56d6-422d-aa43-de74f3cf70da-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-779a2255-2899-419b-9308-fd2592677c61-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-779a2255-2899-419b-9308-fd2592677c61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-quobyte-779a2255-2899-419b-9308-fd2592677c61" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-779a2255-2899-419b-9308-fd2592677c61" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Deleting offline snapshot 779a2255-2899-419b-9308-fd2592677c61 of volume b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] snapshot_file for this snap is: volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e7bd99-1f4d-4442-88ed-afab8b225269]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:27 devstack sudo[104001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61
Nov 03 08:15:27 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:27 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61" returned: 0 in 0.360s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:15:27 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[54931749-41cd-43e4-a704-078cb16f45c1]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:27 devstack sudo[104006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed
Nov 03 08:15:27 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:27 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed" returned: 0 in 0.343s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:27 devstack sudo[104011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61
Nov 03 08:15:27 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:27 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61" returned: 0 in 0.325s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:28 devstack sudo[104017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61
Nov 03 08:15:28 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:28 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed.779a2255-2899-419b-9308-fd2592677c61" returned: 0 in 0.244s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-779a2255-2899-419b-9308-fd2592677c61" released by "_delete_snapshot" :: held 1.375s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" released by "delete_snapshot" :: held 1.394s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:28 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Created reservations ['f072b2de-eb69-46c6-96c7-1c8537779938', '7df0b45b-faa1-4bb9-af71-b0006f407d67', '94174e37-28f0-47a4-93f9-2f6fa9cf219d', 'd72d1b6f-4f1a-4f25-9f5f-4fdb6dfd9746'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:15:28 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Delete snapshot completed successfully.
Nov 03 08:15:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6cca99eb-f895-44ce-b448-9e2fd30a6cce tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-779a2255-2899-419b-9308-fd2592677c61-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-b60815ec-b43d-4cb7-a8cd-58c194c31bed-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-b60815ec-b43d-4cb7-a8cd-58c194c31bed-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" acquired by "delete_volume" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d51ccc7-4db3-4994-a4bb-51267141b6e6]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:29 devstack sudo[104021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed
Nov 03 08:15:29 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:29 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed" returned: 0 in 0.389s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:29 devstack sudo[104027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed
Nov 03 08:15:29 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:29 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b60815ec-b43d-4cb7-a8cd-58c194c31bed" returned: 0 in 0.233s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-quobyte-b60815ec-b43d-4cb7-a8cd-58c194c31bed" released by "delete_volume" :: held 0.682s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Created reservations ['e405fc80-2f1b-4483-ae9e-216ec799b1f5', 'bb3d2e6a-4e6e-4a5c-90de-6fa09071592c', '3f1e1fe9-8564-4b4e-8111-ce5ee2bed85f', 'd156a730-ad44-413d-be6f-076035d9484f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:15:29 devstack sudo[104030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:15:29 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:15:30 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root
Nov 03 08:15:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:15:30 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:15:30 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Deleted volume successfully.
Nov 03 08:15:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-25d1ecdf-b846-4b15-92f7-86f50cfb632e tempest-VolumesSnapshotListTestJSON-654294529 None] Lock "cinder-b60815ec-b43d-4cb7-a8cd-58c194c31bed-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:15:39 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=69,cinder:INSERT=26,cinder:UPDATE=60,cinder:DELETE=6 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:15:40 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=68,cinder:DELETE=5,cinder:SELECT=53,cinder:INSERT=18 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:15:51 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-1a59ba11-9c6a-427e-9742-74fce9d3eff8 req-c01fd656-d5b3-4862-90c7-cb0262e365ec tempest-TestShelveInstance-916800310 None] Terminate volume connection completed successfully.
Nov 03 08:15:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-1a59ba11-9c6a-427e-9742-74fce9d3eff8 req-c01fd656-d5b3-4862-90c7-cb0262e365ec tempest-TestShelveInstance-916800310 None] Deleting attachment 600b59ad-3d28-427a-85bc-49f249ba7861. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:15:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-cac97253-aeff-4e74-b9a7-4383b9549dd1 req-e57387af-f667-4488-8196-fcb68ec81608 tempest-TestShelveInstance-916800310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:15:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-cac97253-aeff-4e74-b9a7-4383b9549dd1 req-e57387af-f667-4488-8196-fcb68ec81608 tempest-TestShelveInstance-916800310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:15:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-cac97253-aeff-4e74-b9a7-4383b9549dd1 req-e57387af-f667-4488-8196-fcb68ec81608 tempest-TestShelveInstance-916800310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:15:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-cac97253-aeff-4e74-b9a7-4383b9549dd1 req-e57387af-f667-4488-8196-fcb68ec81608 tempest-TestShelveInstance-916800310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-79b48d7c-1863-449a-96e3-c65d5cc3976e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bebc585-6b73-4432-a1fe-32da0bc1d819', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:15:54 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-cac97253-aeff-4e74-b9a7-4383b9549dd1 req-e57387af-f667-4488-8196-fcb68ec81608 tempest-TestShelveInstance-916800310 None] attachment_update completed successfully.
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:03 devstack sudo[104687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:16:03 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:03 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:16:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:16:04 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:16:04 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Flow 'volume_create_manager' (a12effba-b59f-475a-9d25-3ff0a1ed1086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c67fe9-8811-4e94-81d2-7fedfd5f5a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c67fe9-8811-4e94-81d2-7fedfd5f5a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-674605791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec59b4da-c176-4dd9-9f8b-a5e06678d18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52707a4c39b4ca49feba07b6d6f7584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:16:23Z,use_quota=True,user_id='30130342f03143e780254716824da5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6db04ee-72eb-4702-b615-ee409b530495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6db04ee-72eb-4702-b615-ee409b530495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa266d7c-9ff1-4db0-b437-7179076d12be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa266d7c-9ff1-4db0-b437-7179076d12be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec59b4da-c176-4dd9-9f8b-a5e06678d18c', 'volume_name': 'volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3c3cf0-08c5-41cf-b4e8-0587aebc0f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3c3cf0-08c5-41cf-b4e8-0587aebc0f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9731f6b7-c70f-4c2c-a07a-fe466f3891a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:22 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Volume ec59b4da-c176-4dd9-9f8b-a5e06678d18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c', 'volume_size': 1}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-674605791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec59b4da-c176-4dd9-9f8b-a5e06678d18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52707a4c39b4ca49feba07b6d6f7584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:16:23Z,use_quota=True,user_id='30130342f03143e780254716824da5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Creating volume ec59b4da-c176-4dd9-9f8b-a5e06678d18c {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:16:22 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:16:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:22 devstack sudo[104751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c 1073741824
Nov 03 08:16:22 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:23 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c 1073741824" returned: 0 in 0.406s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:23 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c
Nov 03 08:16:23 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:23 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c" returned: 0 in 0.237s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:16:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9731f6b7-c70f-4c2c-a07a-fe466f3891a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36d1393-afa9-4903-92cd-2b01eeba2370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:23 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Volume volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c (ec59b4da-c176-4dd9-9f8b-a5e06678d18c): created successfully
Nov 03 08:16:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36d1393-afa9-4903-92cd-2b01eeba2370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Flow 'volume_create_manager' (a12effba-b59f-475a-9d25-3ff0a1ed1086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:16:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3ff8bc16-fdaf-4052-abab-be519e2b6e11 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Created volume successfully.
Nov 03 08:16:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-8a32c978-3034-498b-a4ce-7085e366002e req-5ea02d12-38a1-4d00-850b-fc359e3b791f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-8a32c978-3034-498b-a4ce-7085e366002e req-5ea02d12-38a1-4d00-850b-fc359e3b791f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-8a32c978-3034-498b-a4ce-7085e366002e req-5ea02d12-38a1-4d00-850b-fc359e3b791f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-8a32c978-3034-498b-a4ce-7085e366002e req-5ea02d12-38a1-4d00-850b-fc359e3b791f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10', 'name': 'volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6448937-0fc2-4c46-aac9-6e1f700c59b3', 'enforce_multipath': True} {{(pid=86851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 08:16:24 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-8a32c978-3034-498b-a4ce-7085e366002e req-5ea02d12-38a1-4d00-850b-fc359e3b791f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] attachment_update completed successfully.
Nov 03 08:16:26 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-807d08e5-33ee-4365-b8d7-3d3bd415a8b2 req-b4724a5a-9c25-463c-a863-c212829b1e52 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Terminate volume connection completed successfully.
Nov 03 08:16:26 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-807d08e5-33ee-4365-b8d7-3d3bd415a8b2 req-b4724a5a-9c25-463c-a863-c212829b1e52 tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Deleting attachment b6448937-0fc2-4c46-aac9-6e1f700c59b3. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Acquiring lock "cinder-ec59b4da-c176-4dd9-9f8b-a5e06678d18c-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "cinder-ec59b4da-c176-4dd9-9f8b-a5e06678d18c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Acquiring lock "cinder-quobyte-ec59b4da-c176-4dd9-9f8b-a5e06678d18c" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "cinder-quobyte-ec59b4da-c176-4dd9-9f8b-a5e06678d18c" acquired by "delete_volume" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b97bf-3648-4471-9783-8f5f2d401c2b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:27 devstack sudo[104776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c
Nov 03 08:16:27 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:27 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c" returned: 0 in 0.361s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:27 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c
Nov 03 08:16:27 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:27 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec59b4da-c176-4dd9-9f8b-a5e06678d18c" returned: 0 in 0.237s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "cinder-quobyte-ec59b4da-c176-4dd9-9f8b-a5e06678d18c" released by "delete_volume" :: held 0.639s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Created reservations ['5f03b225-a126-4aaf-8dcf-afd04774536b', 'b7b1bef3-2b99-4599-8f66-f6ab01bade7a', 'fc2e67b8-eb7a-4612-b6d0-c530872b24a4', '075fbb17-1df7-4e91-925f-fd4738a6863d'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:27 devstack sudo[104784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:16:27 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:28 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.241s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:28 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:16:28 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Deleted volume successfully.
Nov 03 08:16:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0560716-3336-4a37-a141-0de9231c919f tempest-TestServerVolumeAttachScenarioOldVersion-2053938279 None] Lock "cinder-ec59b4da-c176-4dd9-9f8b-a5e06678d18c-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:16:37 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=12,cinder:SELECT=14,cinder:INSERT=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:16:38 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:16:39 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-3851b6b2-3a48-4056-95ed-5f7f7b60a35e tempest-TestShelveInstance-916800310 None] Terminate volume connection completed successfully.
Nov 03 08:16:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-3851b6b2-3a48-4056-95ed-5f7f7b60a35e tempest-TestShelveInstance-916800310 None] Deleting attachment 3bebc585-6b73-4432-a1fe-32da0bc1d819. {{(pid=86851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 08:16:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Acquiring lock "cinder-79b48d7c-1863-449a-96e3-c65d5cc3976e-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:16:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Lock "cinder-79b48d7c-1863-449a-96e3-c65d5cc3976e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:16:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Acquiring lock "cinder-quobyte-79b48d7c-1863-449a-96e3-c65d5cc3976e" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:16:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Lock "cinder-quobyte-79b48d7c-1863-449a-96e3-c65d5cc3976e" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:16:39 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb042cac-9879-4d86-8549-5959ac8a6dac]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:16:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:40 devstack sudo[104883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e
Nov 03 08:16:40 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:40 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e" returned: 0 in 0.512s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:40 devstack sudo[104889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e
Nov 03 08:16:40 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:40 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-79b48d7c-1863-449a-96e3-c65d5cc3976e" returned: 0 in 0.264s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Lock "cinder-quobyte-79b48d7c-1863-449a-96e3-c65d5cc3976e" released by "delete_volume" :: held 0.836s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG cinder.quota [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Created reservations ['f2ba9eb9-8efc-4bd3-8a44-e5b813c3f2dc', '4e22be6e-1ced-47d7-810a-fc5e00bfe504', 'ca8f3d4b-0d1a-4c76-8920-e85c1ddf76c2', '0689611d-3709-4aee-b587-bfbbfae1fc91'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:40 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:16:40 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:41 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.368s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:41 devstack cinder-volume[86851]: DEBUG cinder.manager [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:16:41 devstack cinder-volume[86851]: INFO cinder.volume.manager [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Deleted volume successfully.
Nov 03 08:16:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [req-ffd8f2df-d622-457a-bd01-1c44cd73343e req-49719cc9-de56-48c5-8e36-6b2c6051c824 tempest-TestShelveInstance-916800310 None] Lock "cinder-79b48d7c-1863-449a-96e3-c65d5cc3976e-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:16:50 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:16:51 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Flow 'volume_create_manager' (3e7cf841-5179-4a70-9d2f-936675812b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9884e72-ef77-4c29-a521-ddfdcc3d4ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9884e72-ef77-4c29-a521-ddfdcc3d4ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901365800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4e152e-4c84-41eb-82ba-831f5ee5f352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6497fec2264192b958145aa8eb4627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:16:54Z,use_quota=True,user_id='13c0c92026e744e880d281248a52befa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ccd745-c221-4ee2-becb-bbb448aff194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ccd745-c221-4ee2-becb-bbb448aff194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8425976-272c-4de4-a9d8-5b032a018fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8425976-272c-4de4-a9d8-5b032a018fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4e152e-4c84-41eb-82ba-831f5ee5f352', 'volume_name': 'volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e188c4-47a6-4f5a-bbf4-ada051062b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e188c4-47a6-4f5a-bbf4-ada051062b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a771e4-5161-4c0d-a365-65136122ab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:54 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Volume 7a4e152e-4c84-41eb-82ba-831f5ee5f352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352', 'volume_size': 1}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901365800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4e152e-4c84-41eb-82ba-831f5ee5f352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6497fec2264192b958145aa8eb4627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:16:54Z,use_quota=True,user_id='13c0c92026e744e880d281248a52befa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Creating volume 7a4e152e-4c84-41eb-82ba-831f5ee5f352 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:16:54 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:54 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352 1073741824
Nov 03 08:16:54 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:54 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352 1073741824" returned: 0 in 0.501s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:54 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352
Nov 03 08:16:54 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:55 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352" returned: 0 in 0.262s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:16:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a771e4-5161-4c0d-a365-65136122ab33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae3b033-73f1-44d5-a87a-aeb08a40c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:55 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Volume volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352 (7a4e152e-4c84-41eb-82ba-831f5ee5f352): created successfully
Nov 03 08:16:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae3b033-73f1-44d5-a87a-aeb08a40c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Flow 'volume_create_manager' (3e7cf841-5179-4a70-9d2f-936675812b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:16:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-972b5738-99cd-4233-8da9-7d4dcb48136a tempest-ProjectReaderTests-989690365 None] Created volume successfully.
Nov 03 08:16:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Acquiring lock "cinder-7a4e152e-4c84-41eb-82ba-831f5ee5f352-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:16:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Lock "cinder-7a4e152e-4c84-41eb-82ba-831f5ee5f352-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:16:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Acquiring lock "cinder-quobyte-7a4e152e-4c84-41eb-82ba-831f5ee5f352" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:16:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Lock "cinder-quobyte-7a4e152e-4c84-41eb-82ba-831f5ee5f352" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:16:56 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1be465-3408-4547-8861-3021ae77491b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:16:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:56 devstack sudo[104911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352
Nov 03 08:16:56 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:57 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352" returned: 0 in 0.367s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:57 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352
Nov 03 08:16:57 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:57 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7a4e152e-4c84-41eb-82ba-831f5ee5f352" returned: 0 in 0.246s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Lock "cinder-quobyte-7a4e152e-4c84-41eb-82ba-831f5ee5f352" released by "delete_volume" :: held 0.661s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Created reservations ['cd5c33a8-b9be-4167-b35f-05d1548da9fb', 'e93dc60c-d754-49a9-8862-e2c6db5d46a0', '807b2e3f-1937-40af-b2f1-4f7c057c0027', 'e553145e-086f-4063-97ff-57edf7e0e791'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:57 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:16:57 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:57 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.260s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:16:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Deleted volume successfully.
Nov 03 08:16:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb26e6d7-1129-4c07-bc7d-e11001beda30 tempest-ProjectReaderTests-989690365 None] Lock "cinder-7a4e152e-4c84-41eb-82ba-831f5ee5f352-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Flow 'volume_create_manager' (0132400d-55c3-4666-9f0e-4d9b72d558cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec196f66-2e89-4d47-b493-ca2bf5503c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec196f66-2e89-4d47-b493-ca2bf5503c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-851254287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38ca9ae-b771-4c2d-874c-22e30c277152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6497fec2264192b958145aa8eb4627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:16:58Z,use_quota=True,user_id='13c0c92026e744e880d281248a52befa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92aa9989-c33c-4467-ac4a-57c9ae7638d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92aa9989-c33c-4467-ac4a-57c9ae7638d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a1ae90-6184-4312-abd2-b61aa256c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a1ae90-6184-4312-abd2-b61aa256c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c38ca9ae-b771-4c2d-874c-22e30c277152', 'volume_name': 'volume-c38ca9ae-b771-4c2d-874c-22e30c277152', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06f58b0-d977-40a2-b326-d3f56043f5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06f58b0-d977-40a2-b326-d3f56043f5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0da9b6-3215-4ae6-9d5c-08569da83760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:58 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Volume c38ca9ae-b771-4c2d-874c-22e30c277152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c38ca9ae-b771-4c2d-874c-22e30c277152', 'volume_size': 1}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-851254287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38ca9ae-b771-4c2d-874c-22e30c277152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db6497fec2264192b958145aa8eb4627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:16:58Z,use_quota=True,user_id='13c0c92026e744e880d281248a52befa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Creating volume c38ca9ae-b771-4c2d-874c-22e30c277152 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:16:58 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:58 devstack sudo[104922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152 1073741824
Nov 03 08:16:58 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:58 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152 1073741824" returned: 0 in 0.440s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:58 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152
Nov 03 08:16:58 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:16:59 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152" returned: 0 in 0.250s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0da9b6-3215-4ae6-9d5c-08569da83760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c38ca9ae-b771-4c2d-874c-22e30c277152', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb390f0-4b85-4b36-bfd3-d5c18b46a1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:16:59 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Volume volume-c38ca9ae-b771-4c2d-874c-22e30c277152 (c38ca9ae-b771-4c2d-874c-22e30c277152): created successfully
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb390f0-4b85-4b36-bfd3-d5c18b46a1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Flow 'volume_create_manager' (0132400d-55c3-4666-9f0e-4d9b72d558cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:16:59 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1b852eb6-93b9-43ca-b556-de0c2dd40949 tempest-ProjectReaderTests-989690365 None] Created volume successfully.
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Acquiring lock "cinder-c38ca9ae-b771-4c2d-874c-22e30c277152-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Lock "cinder-c38ca9ae-b771-4c2d-874c-22e30c277152-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Acquiring lock "cinder-quobyte-c38ca9ae-b771-4c2d-874c-22e30c277152" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Lock "cinder-quobyte-c38ca9ae-b771-4c2d-874c-22e30c277152" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b20c64-588a-4a05-a6a5-215810244bb5]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:16:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:16:59 devstack sudo[104931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152
Nov 03 08:16:59 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:00 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152" returned: 0 in 0.478s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:00 devstack sudo[104936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152
Nov 03 08:17:00 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:00 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c38ca9ae-b771-4c2d-874c-22e30c277152" returned: 0 in 0.275s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Lock "cinder-quobyte-c38ca9ae-b771-4c2d-874c-22e30c277152" released by "delete_volume" :: held 0.806s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Created reservations ['dfbce6f6-b861-4daa-866f-2a6ba3ca4217', 'a0946ac4-90a2-4141-8052-a0b05ea9e20b', 'a6eb2047-6e76-4481-862c-2d08b5625cdb', '96fc7cfb-ab9c-473d-8d06-9adba7e43d7d'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:00 devstack sudo[104939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:00 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:00 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.278s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:17:00 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Deleted volume successfully.
Nov 03 08:17:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7d198c45-b2a2-4057-b3fe-3faf8e6f7089 tempest-ProjectReaderTests-989690365 None] Lock "cinder-c38ca9ae-b771-4c2d-874c-22e30c277152-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:03 devstack sudo[104946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:03 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:03 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.289s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:17:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Flow 'volume_create_manager' (3fdade7e-005b-4095-8d4e-08d7c980817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a265b4-828a-48ba-9928-26aa51b7b0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a265b4-828a-48ba-9928-26aa51b7b0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-214431146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbd2091-36c5-49f9-b563-3a68598ef6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e225292a6f490897fd7ef830000cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:07Z,use_quota=True,user_id='6cd7924a8bcc4181b9aa69730a718487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3193cc03-d63c-49d3-92e8-be6f85aef46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3193cc03-d63c-49d3-92e8-be6f85aef46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0f5298-3e3c-43e6-be0f-b253507e00d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0f5298-3e3c-43e6-be0f-b253507e00d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbd2091-36c5-49f9-b563-3a68598ef6e2', 'volume_name': 'volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eff0ef0-efd1-45ee-b85e-2d81ea0e70e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eff0ef0-efd1-45ee-b85e-2d81ea0e70e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fd3f2b-824d-4925-a201-6d07bab7f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:07 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Volume 2cbd2091-36c5-49f9-b563-3a68598ef6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2', 'volume_size': 1}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-214431146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbd2091-36c5-49f9-b563-3a68598ef6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e225292a6f490897fd7ef830000cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:07Z,use_quota=True,user_id='6cd7924a8bcc4181b9aa69730a718487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Creating volume 2cbd2091-36c5-49f9-b563-3a68598ef6e2 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:17:07 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:07 devstack sudo[104950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 1073741824
Nov 03 08:17:07 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:07 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 1073741824" returned: 0 in 0.446s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:08 devstack sudo[104956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2
Nov 03 08:17:08 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:08 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2" returned: 0 in 0.250s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:17:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fd3f2b-824d-4925-a201-6d07bab7f779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64febfb-2f03-4ce2-b73e-46048f30575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:08 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Volume volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 (2cbd2091-36c5-49f9-b563-3a68598ef6e2): created successfully
Nov 03 08:17:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64febfb-2f03-4ce2-b73e-46048f30575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Flow 'volume_create_manager' (3fdade7e-005b-4095-8d4e-08d7c980817c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-01675599-e0e6-4a7c-bc04-d6f783d867ae tempest-TestImageHashVerification-1178501575 None] Created volume successfully.
Nov 03 08:17:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:09 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f95eaf3-e23c-4d51-9f18-dde9988149cd]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:09 devstack sudo[104959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2
Nov 03 08:17:09 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:09 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2" returned: 0 in 0.373s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:09 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e263ef3-ab7f-49f2-bffe-791b6feaf8c8]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:09 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2
Nov 03 08:17:09 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:10 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2" returned: 0 in 0.411s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 /opt/stack/data/cinder/conversion/2cbd2091-36c5-49f9-b563-3a68598ef6e2.temp_image.e7d46926-e6d4-4b27-aa4a-742965fddc0d1b7ap1ty.img {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:10 devstack sudo[104970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 /opt/stack/data/cinder/conversion/2cbd2091-36c5-49f9-b563-3a68598ef6e2.temp_image.e7d46926-e6d4-4b27-aa4a-742965fddc0d1b7ap1ty.img
Nov 03 08:17:10 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Flow 'volume_create_manager' (eb0684d0-4c48-4821-870e-3ccc98cf25d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d73c6c-19e2-4d8d-ab2f-f3db8789575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d73c6c-19e2-4d8d-ab2f-f3db8789575b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614099388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e301b4f7429e404cbab219f293d90eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:17Z,use_quota=True,user_id='3dfe3e8c51fe4e6695030b12369d2b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88133c7-765f-46eb-944a-06481a676d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88133c7-765f-46eb-944a-06481a676d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4c7e4f-bb72-4f18-863b-c2484b998ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4c7e4f-bb72-4f18-863b-c2484b998ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0', 'volume_name': 'volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a56356-8243-4ac2-9588-9beca61c2808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a56356-8243-4ac2-9588-9beca61c2808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b7a98d-2f50-4132-a4a8-298a05c356e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:16 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Volume 99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0', 'volume_size': 1}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:16 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 /opt/stack/data/cinder/conversion/2cbd2091-36c5-49f9-b563-3a68598ef6e2.temp_image.e7d46926-e6d4-4b27-aa4a-742965fddc0d1b7ap1ty.img" returned: 0 in 6.806s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8142383-c543-4920-83f0-6fc9e16fffac]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:16 devstack sudo[104984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2
Nov 03 08:17:16 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:17 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2" returned: 0 in 0.524s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:17 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/conversion/2cbd2091-36c5-49f9-b563-3a68598ef6e2.temp_image.e7d46926-e6d4-4b27-aa4a-742965fddc0d1b7ap1ty.img {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:17:17 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Converted 1024.00 MB image at 150.45 MB/s
Nov 03 08:17:17 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] e7d46926-e6d4-4b27-aa4a-742965fddc0d was raw, no need to convert to raw {{(pid=86851) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 03 08:17:28 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=19,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:17:28 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.824s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Uploaded volume to glance image-id: e7d46926-e6d4-4b27-aa4a-742965fddc0d. {{(pid=86851) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.259s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614099388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e301b4f7429e404cbab219f293d90eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:17Z,use_quota=True,user_id='3dfe3e8c51fe4e6695030b12369d2b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Creating volume 99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:17:36 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:36 devstack sudo[105001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0 1073741824
Nov 03 08:17:36 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d4b57eef-e15d-4ed5-b8c6-42964ecc7a07 tempest-TestImageHashVerification-1178501575 None] Copy volume to image completed successfully.
Nov 03 08:17:36 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:36 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0 1073741824" returned: 0 in 0.430s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:36 devstack sudo[105007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0
Nov 03 08:17:36 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Acquiring lock "cinder-2cbd2091-36c5-49f9-b563-3a68598ef6e2-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:36 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Lock "cinder-2cbd2091-36c5-49f9-b563-3a68598ef6e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0" returned: 0 in 0.257s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b7a98d-2f50-4132-a4a8-298a05c356e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21617d89-f762-48e5-aaa0-3147d268cec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:36 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Volume volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0 (99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0): created successfully
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21617d89-f762-48e5-aaa0-3147d268cec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Flow 'volume_create_manager' (eb0684d0-4c48-4821-870e-3ccc98cf25d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Acquiring lock "cinder-quobyte-2cbd2091-36c5-49f9-b563-3a68598ef6e2" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:36 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7678f669-b9ff-4492-aacd-6e2fd1cd6ed4 tempest-ProjectReaderTests-705021249 None] Created volume successfully.
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Lock "cinder-quobyte-2cbd2091-36c5-49f9-b563-3a68598ef6e2" acquired by "delete_volume" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[071ad48c-d057-4948-8038-199974d61d85]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:36 devstack sudo[105010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2
Nov 03 08:17:36 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:37 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2" returned: 0 in 0.370s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:37 devstack sudo[105049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2
Nov 03 08:17:37 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:37 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-2cbd2091-36c5-49f9-b563-3a68598ef6e2" returned: 0 in 0.245s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Lock "cinder-quobyte-2cbd2091-36c5-49f9-b563-3a68598ef6e2" released by "delete_volume" :: held 0.651s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Created reservations ['67f4fefe-0ac9-46d2-9231-d278e755eed4', '6da7fc7a-d953-4b6c-b512-a773bbeb7289', '06ab1cdd-0829-47fa-b54e-cceb84af1cbc', '44056364-e733-4f6e-8cef-9564f9bcb7d1'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:37 devstack sudo[105054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:37 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:37 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.250s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:17:37 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Deleted volume successfully.
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ebf41b61-2dc7-451f-a071-2fce8caa0b23 tempest-TestImageHashVerification-1178501575 None] Lock "cinder-2cbd2091-36c5-49f9-b563-3a68598ef6e2-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Acquiring lock "cinder-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Lock "cinder-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Acquiring lock "cinder-quobyte-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Lock "cinder-quobyte-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0" acquired by "delete_volume" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81fdb0c-02de-45a8-b027-a4a18e97b4d2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:38 devstack sudo[105057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0
Nov 03 08:17:38 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:38 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0" returned: 0 in 0.382s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:38 devstack sudo[105062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0
Nov 03 08:17:38 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:38 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0" returned: 0 in 0.288s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Lock "cinder-quobyte-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0" released by "delete_volume" :: held 0.718s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Created reservations ['45f22787-fbfc-44c4-b198-df4a71304c3e', '47239d20-b082-4a0e-a383-318b05bdb3ad', '37bebb69-1908-4f26-a4e6-fd86de35dafd', 'dd36a840-57d9-48d0-a8ea-efd4f64752bb'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:38 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:38 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:39 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.260s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:17:39 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Deleted volume successfully.
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cca11690-9363-4330-8c58-0cebada33fcc tempest-ProjectReaderTests-705021249 None] Lock "cinder-99b3c7d5-acb3-4ec0-9e9b-16b9eba80aa0-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Flow 'volume_create_manager' (987ee37d-bed6-4ce7-92fd-d51c8413b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4e6b58-4f13-4131-b3bf-bcc5c19b6b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4e6b58-4f13-4131-b3bf-bcc5c19b6b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916250689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3068fb5c-2187-44c9-8199-936f56a93a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e301b4f7429e404cbab219f293d90eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:40Z,use_quota=True,user_id='3dfe3e8c51fe4e6695030b12369d2b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6236f5e-d700-4f17-9ad3-33cbb7f7d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6236f5e-d700-4f17-9ad3-33cbb7f7d16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed21f707-9cab-4d4c-97dd-b8f5581ddfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed21f707-9cab-4d4c-97dd-b8f5581ddfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3068fb5c-2187-44c9-8199-936f56a93a1d', 'volume_name': 'volume-3068fb5c-2187-44c9-8199-936f56a93a1d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22082eb-9f44-44a7-ba5a-bb32ef169d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22082eb-9f44-44a7-ba5a-bb32ef169d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2c986f-48cd-4297-a1bd-8fcf68c2e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:39 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Volume 3068fb5c-2187-44c9-8199-936f56a93a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3068fb5c-2187-44c9-8199-936f56a93a1d', 'volume_size': 1}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916250689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3068fb5c-2187-44c9-8199-936f56a93a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e301b4f7429e404cbab219f293d90eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:40Z,use_quota=True,user_id='3dfe3e8c51fe4e6695030b12369d2b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Creating volume 3068fb5c-2187-44c9-8199-936f56a93a1d {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:17:39 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:17:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:39 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d 1073741824
Nov 03 08:17:39 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:40 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d 1073741824" returned: 0 in 0.422s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:40 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d
Nov 03 08:17:40 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:40 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d" returned: 0 in 0.269s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2c986f-48cd-4297-a1bd-8fcf68c2e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3068fb5c-2187-44c9-8199-936f56a93a1d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc8fc58-ee9d-4a1c-b48e-78419baa2cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:40 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Volume volume-3068fb5c-2187-44c9-8199-936f56a93a1d (3068fb5c-2187-44c9-8199-936f56a93a1d): created successfully
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc8fc58-ee9d-4a1c-b48e-78419baa2cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Flow 'volume_create_manager' (987ee37d-bed6-4ce7-92fd-d51c8413b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:40 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-fe7867bb-a811-45eb-9e11-f5388eaf8dbe tempest-ProjectReaderTests-705021249 None] Created volume successfully.
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Acquiring lock "cinder-3068fb5c-2187-44c9-8199-936f56a93a1d-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Lock "cinder-3068fb5c-2187-44c9-8199-936f56a93a1d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Acquiring lock "cinder-quobyte-3068fb5c-2187-44c9-8199-936f56a93a1d" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Lock "cinder-quobyte-3068fb5c-2187-44c9-8199-936f56a93a1d" acquired by "delete_volume" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[065adb8a-053d-450e-bb76-493009aee87f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:40 devstack sudo[105080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d
Nov 03 08:17:40 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:41 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d" returned: 0 in 0.360s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:41 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d
Nov 03 08:17:41 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:41 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3068fb5c-2187-44c9-8199-936f56a93a1d" returned: 0 in 0.291s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Lock "cinder-quobyte-3068fb5c-2187-44c9-8199-936f56a93a1d" released by "delete_volume" :: held 0.693s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Created reservations ['479a118e-7937-46ad-b056-4a8a64877c2e', 'edc17043-5c0a-49e8-8ec7-a06abfb81e0d', 'b24f1f92-48b6-4647-baf4-cb5f22eeea54', '30efc83d-a594-49fd-aeac-a3167e64b6a2'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:41 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:41 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:41 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.257s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:17:41 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Deleted volume successfully.
Nov 03 08:17:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b86c2cb2-174f-4965-8a4f-ae5f71a9491c tempest-ProjectReaderTests-705021249 None] Lock "cinder-3068fb5c-2187-44c9-8199-936f56a93a1d-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Flow 'volume_create_manager' (f77f35fa-7ba0-4dc7-85b0-44b28fd69a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13995aa-dc35-42e7-8ad3-e57903985754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13995aa-dc35-42e7-8ad3-e57903985754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192900237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00127863-3513-474e-a302-633820d721b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e301b4f7429e404cbab219f293d90eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:42Z,use_quota=True,user_id='3dfe3e8c51fe4e6695030b12369d2b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb86f740-08bf-4e19-bf85-0f78d92798fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb86f740-08bf-4e19-bf85-0f78d92798fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37355f17-f742-4405-bbc1-a910c783cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37355f17-f742-4405-bbc1-a910c783cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00127863-3513-474e-a302-633820d721b0', 'volume_name': 'volume-00127863-3513-474e-a302-633820d721b0', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f60b14-fd73-40b6-ad2d-e0e845cb3d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f60b14-fd73-40b6-ad2d-e0e845cb3d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561c2f73-7cb0-41c9-931e-2dd716801acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:42 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Volume 00127863-3513-474e-a302-633820d721b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00127863-3513-474e-a302-633820d721b0', 'volume_size': 1}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192900237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00127863-3513-474e-a302-633820d721b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e301b4f7429e404cbab219f293d90eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:42Z,use_quota=True,user_id='3dfe3e8c51fe4e6695030b12369d2b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Creating volume 00127863-3513-474e-a302-633820d721b0 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:17:42 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:42 devstack sudo[105092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0 1073741824
Nov 03 08:17:42 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:42 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0 1073741824" returned: 0 in 0.412s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:42 devstack sudo[105099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0
Nov 03 08:17:42 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:43 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0" returned: 0 in 0.252s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561c2f73-7cb0-41c9-931e-2dd716801acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00127863-3513-474e-a302-633820d721b0', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba1b0fc-dcb9-435e-9d38-8128845556c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:43 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Volume volume-00127863-3513-474e-a302-633820d721b0 (00127863-3513-474e-a302-633820d721b0): created successfully
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba1b0fc-dcb9-435e-9d38-8128845556c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Flow 'volume_create_manager' (f77f35fa-7ba0-4dc7-85b0-44b28fd69a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f921b9d8-948f-4a6a-b79a-dc9e06d8044a tempest-ProjectReaderTests-705021249 None] Created volume successfully.
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Acquiring lock "cinder-00127863-3513-474e-a302-633820d721b0-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Lock "cinder-00127863-3513-474e-a302-633820d721b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Acquiring lock "cinder-quobyte-00127863-3513-474e-a302-633820d721b0" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Lock "cinder-quobyte-00127863-3513-474e-a302-633820d721b0" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6621e07-f8d9-4367-a4e0-92b0f9741ebd]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:43 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0
Nov 03 08:17:43 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:43 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0" returned: 0 in 0.354s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:43 devstack sudo[105108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0
Nov 03 08:17:43 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:44 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-00127863-3513-474e-a302-633820d721b0" returned: 0 in 0.244s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Lock "cinder-quobyte-00127863-3513-474e-a302-633820d721b0" released by "delete_volume" :: held 0.664s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Created reservations ['a41a04f4-daf3-4da1-9059-1d94ed1336c0', 'a9e7c726-1f5a-4338-8a5d-b299f369c5ff', 'f1910ff3-f8f6-4823-8d1f-eb773c9c4041', 'fdeeae5a-f535-40fa-aea1-74258a5ea2d9'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:44 devstack sudo[105112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:44 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:44 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.262s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:17:44 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Deleted volume successfully.
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cc66c521-a31f-41d2-9196-a754765a6928 tempest-ProjectReaderTests-705021249 None] Lock "cinder-00127863-3513-474e-a302-633820d721b0-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:44 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Flow 'volume_create_manager' (d5ace229-ffeb-4927-80ba-5c73359631fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dfe142-b7f7-42ce-8509-d7d68209eb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dfe142-b7f7-42ce-8509-d7d68209eb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221062104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015f91b4-4de3-443e-ab83-3577ce4c8b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e301b4f7429e404cbab219f293d90eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:45Z,use_quota=True,user_id='3dfe3e8c51fe4e6695030b12369d2b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9241a9b5-6fc0-4529-9410-10dd6b2e1d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9241a9b5-6fc0-4529-9410-10dd6b2e1d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df31e551-a53c-40b2-a1aa-da648dd27c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df31e551-a53c-40b2-a1aa-da648dd27c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015f91b4-4de3-443e-ab83-3577ce4c8b03', 'volume_name': 'volume-015f91b4-4de3-443e-ab83-3577ce4c8b03', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae4987c-500c-4aa6-8531-07f273982fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae4987c-500c-4aa6-8531-07f273982fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5200852d-a061-41e4-885c-72aa6aa7899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:45 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Volume 015f91b4-4de3-443e-ab83-3577ce4c8b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015f91b4-4de3-443e-ab83-3577ce4c8b03', 'volume_size': 1}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221062104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015f91b4-4de3-443e-ab83-3577ce4c8b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e301b4f7429e404cbab219f293d90eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:45Z,use_quota=True,user_id='3dfe3e8c51fe4e6695030b12369d2b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Creating volume 015f91b4-4de3-443e-ab83-3577ce4c8b03 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:17:45 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:45 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03 1073741824
Nov 03 08:17:45 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:45 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03 1073741824" returned: 0 in 0.410s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:45 devstack sudo[105121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03
Nov 03 08:17:45 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:45 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03" returned: 0 in 0.249s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5200852d-a061-41e4-885c-72aa6aa7899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015f91b4-4de3-443e-ab83-3577ce4c8b03', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc95cd6c-9024-4e4e-8bd3-52cf3bc45360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:45 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Volume volume-015f91b4-4de3-443e-ab83-3577ce4c8b03 (015f91b4-4de3-443e-ab83-3577ce4c8b03): created successfully
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc95cd6c-9024-4e4e-8bd3-52cf3bc45360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:45 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Flow 'volume_create_manager' (d5ace229-ffeb-4927-80ba-5c73359631fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:45 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-6743c9af-0bf8-49b5-8fff-a899e81f19fd tempest-ProjectReaderTests-705021249 None] Created volume successfully.
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Acquiring lock "cinder-015f91b4-4de3-443e-ab83-3577ce4c8b03-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Lock "cinder-015f91b4-4de3-443e-ab83-3577ce4c8b03-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Acquiring lock "cinder-quobyte-015f91b4-4de3-443e-ab83-3577ce4c8b03" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Lock "cinder-quobyte-015f91b4-4de3-443e-ab83-3577ce4c8b03" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d7f39b-80b9-460c-95cb-38210a9a7c54]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:46 devstack sudo[105124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03
Nov 03 08:17:46 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:46 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03" returned: 0 in 0.394s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:46 devstack sudo[105129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03
Nov 03 08:17:46 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:46 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-015f91b4-4de3-443e-ab83-3577ce4c8b03" returned: 0 in 0.279s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Lock "cinder-quobyte-015f91b4-4de3-443e-ab83-3577ce4c8b03" released by "delete_volume" :: held 0.733s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Created reservations ['742997ef-c6f9-4d5f-914a-32c169f31a04', '8f5946c6-1f28-4294-8d93-79d3ba74d4d6', '340c2d2e-5fb8-4f9c-867a-ab3ec6caf5ab', 'd73d505f-9d41-476a-b514-08cda7d253a2'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:47 devstack sudo[105133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:47 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:47 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.281s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:47 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:17:47 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Deleted volume successfully.
Nov 03 08:17:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0dfb101b-87e8-44be-b25b-e2c5a953fd03 tempest-ProjectReaderTests-705021249 None] Lock "cinder-015f91b4-4de3-443e-ab83-3577ce4c8b03-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Flow 'volume_create_manager' (603f46fc-5402-40d5-84f4-3203705cdf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954e5b00-ae70-4cb9-940b-08a4d081c9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954e5b00-ae70-4cb9-940b-08a4d081c9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2095249007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a5377ea-953b-40e4-9f74-296ffa92961a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203dfdf76c246bc823f00e4de44ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:50Z,use_quota=True,user_id='d09a918faf2e4c5b8d0052e35ef52c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d427ccc-c85b-44eb-a263-565de51e3496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d427ccc-c85b-44eb-a263-565de51e3496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437e8cc7-94ba-4133-8099-fa8dc44904cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437e8cc7-94ba-4133-8099-fa8dc44904cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a5377ea-953b-40e4-9f74-296ffa92961a', 'volume_name': 'volume-9a5377ea-953b-40e4-9f74-296ffa92961a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf1c401-b5c0-4542-af2a-a959cdbdc720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf1c401-b5c0-4542-af2a-a959cdbdc720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae40dcec-11c7-4e27-9f21-5cb14c635822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Volume 9a5377ea-953b-40e4-9f74-296ffa92961a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a5377ea-953b-40e4-9f74-296ffa92961a', 'volume_size': 1}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2095249007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a5377ea-953b-40e4-9f74-296ffa92961a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203dfdf76c246bc823f00e4de44ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:50Z,use_quota=True,user_id='d09a918faf2e4c5b8d0052e35ef52c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Creating volume 9a5377ea-953b-40e4-9f74-296ffa92961a {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:17:50 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:50 devstack sudo[105136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a 1073741824
Nov 03 08:17:50 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Flow 'volume_create_manager' (d7eb0783-2b09-408f-a1e9-e32e512b5baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1d7ba2-fba7-46f0-bd7f-7bc5f58cc532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1d7ba2-fba7-46f0-bd7f-7bc5f58cc532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1165596024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5cc72f-4883-49d8-84a6-8954de8ae6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203dfdf76c246bc823f00e4de44ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:50Z,use_quota=True,user_id='d09a918faf2e4c5b8d0052e35ef52c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afb5557-f6f2-4cf1-b7ee-e79121b7b7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afb5557-f6f2-4cf1-b7ee-e79121b7b7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a944168-70ee-424b-94a1-9eb02cd5c32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a944168-70ee-424b-94a1-9eb02cd5c32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5cc72f-4883-49d8-84a6-8954de8ae6bf', 'volume_name': 'volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc718208-b01d-44a7-a858-c2e8e6e262a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc718208-b01d-44a7-a858-c2e8e6e262a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf6e5b0-bacd-4073-83c8-f833b168785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Volume 7d5cc72f-4883-49d8-84a6-8954de8ae6bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf', 'volume_size': 1}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:50 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a 1073741824" returned: 0 in 0.626s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:50 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a
Nov 03 08:17:50 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Flow 'volume_create_manager' (43252fa0-ff14-4bc1-9e25-d297ca71bfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2685899-a6d5-4f10-9929-7a197f588c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2685899-a6d5-4f10-9929-7a197f588c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446240201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69c58f4-e9d5-4a18-bb75-2ba310e090cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203dfdf76c246bc823f00e4de44ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:51Z,use_quota=True,user_id='d09a918faf2e4c5b8d0052e35ef52c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec22917-0628-441b-9fb0-0e27f313ccff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec22917-0628-441b-9fb0-0e27f313ccff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e84d5ea-08ae-46b3-8e78-ef861539e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e84d5ea-08ae-46b3-8e78-ef861539e39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd69c58f4-e9d5-4a18-bb75-2ba310e090cd', 'volume_name': 'volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1f4c4c-7806-4e6a-a15a-ca1efc2bf8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1f4c4c-7806-4e6a-a15a-ca1efc2bf8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889ef2a7-1039-4c6a-bb6b-5831575c06ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:50 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Volume d69c58f4-e9d5-4a18-bb75-2ba310e090cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd', 'volume_size': 1}
Nov 03 08:17:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:51 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a" returned: 0 in 0.347s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1165596024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5cc72f-4883-49d8-84a6-8954de8ae6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203dfdf76c246bc823f00e4de44ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:50Z,use_quota=True,user_id='d09a918faf2e4c5b8d0052e35ef52c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Creating volume 7d5cc72f-4883-49d8-84a6-8954de8ae6bf {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:17:51 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae40dcec-11c7-4e27-9f21-5cb14c635822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a5377ea-953b-40e4-9f74-296ffa92961a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:51 devstack sudo[105145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf 1073741824
Nov 03 08:17:51 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94eaf43-fdbb-4650-be6c-121862ff47f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Volume volume-9a5377ea-953b-40e4-9f74-296ffa92961a (9a5377ea-953b-40e4-9f74-296ffa92961a): created successfully
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94eaf43-fdbb-4650-be6c-121862ff47f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Flow 'volume_create_manager' (603f46fc-5402-40d5-84f4-3203705cdf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:51 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d58ba2cc-2a58-4e3c-bc31-295063005df6 tempest-CreateVolumesFromImageTest-1386802009 None] Created volume successfully.
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Flow 'volume_create_manager' (91e2c9ac-8568-4de6-ba4d-59381ae8040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1681bc4-e7ea-4216-906c-12013957063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1681bc4-e7ea-4216-906c-12013957063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532643024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68873bfa-c7b8-4709-9cf7-5a5d8e3110ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203dfdf76c246bc823f00e4de44ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:51Z,use_quota=True,user_id='d09a918faf2e4c5b8d0052e35ef52c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2ea089-0a0e-4c80-8dbc-f375ec68a8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2ea089-0a0e-4c80-8dbc-f375ec68a8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3800a2-76e6-4e63-8a54-acfc24f5fc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3800a2-76e6-4e63-8a54-acfc24f5fc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68873bfa-c7b8-4709-9cf7-5a5d8e3110ec', 'volume_name': 'volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b122a175-499f-4e9f-8be8-4794316ed998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b122a175-499f-4e9f-8be8-4794316ed998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ec9554-4ef5-4f95-8966-40b9fe3e84a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Volume 68873bfa-c7b8-4709-9cf7-5a5d8e3110ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec', 'volume_size': 1}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Flow 'volume_create_manager' (6b9df50d-ba1e-4b87-b0bd-df6c831e8e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112692c3-99ce-46c9-99f4-893ec41b6b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112692c3-99ce-46c9-99f4-893ec41b6b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902843798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b420eb-bbf5-477a-a87e-7b61ec30f4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203dfdf76c246bc823f00e4de44ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:52Z,use_quota=True,user_id='d09a918faf2e4c5b8d0052e35ef52c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a77a68-0316-4ec5-9664-ba770cd88b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a77a68-0316-4ec5-9664-ba770cd88b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611171cf-6d24-4604-8c9b-1349f7a9143c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611171cf-6d24-4604-8c9b-1349f7a9143c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1b420eb-bbf5-477a-a87e-7b61ec30f4f3', 'volume_name': 'volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f889c0-d678-48cb-bd92-982e040d9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f889c0-d678-48cb-bd92-982e040d9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b33067b-ff6b-4b3f-9696-7096c511c462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:51 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Volume e1b420eb-bbf5-477a-a87e-7b61ec30f4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3', 'volume_size': 1}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf 1073741824" returned: 0 in 0.801s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:52 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf
Nov 03 08:17:52 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:52 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf" returned: 0 in 0.262s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.308s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446240201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69c58f4-e9d5-4a18-bb75-2ba310e090cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203dfdf76c246bc823f00e4de44ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:51Z,use_quota=True,user_id='d09a918faf2e4c5b8d0052e35ef52c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Creating volume d69c58f4-e9d5-4a18-bb75-2ba310e090cd {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:17:52 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf6e5b0-bacd-4073-83c8-f833b168785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:52 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd 1073741824
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc786dd1-48e1-4bc4-aecc-2d95e6e7aadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:52 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:52 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Volume volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf (7d5cc72f-4883-49d8-84a6-8954de8ae6bf): created successfully
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc786dd1-48e1-4bc4-aecc-2d95e6e7aadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Flow 'volume_create_manager' (d7eb0783-2b09-408f-a1e9-e32e512b5baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:52 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ff79993b-8f96-4be1-a3f9-d377c42326d5 tempest-CreateVolumesFromImageTest-1386802009 None] Created volume successfully.
Nov 03 08:17:52 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd 1073741824" returned: 0 in 0.426s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:52 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd
Nov 03 08:17:52 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:53 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd" returned: 0 in 0.269s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.557s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532643024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68873bfa-c7b8-4709-9cf7-5a5d8e3110ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203dfdf76c246bc823f00e4de44ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:51Z,use_quota=True,user_id='d09a918faf2e4c5b8d0052e35ef52c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Creating volume 68873bfa-c7b8-4709-9cf7-5a5d8e3110ec {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:17:53 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889ef2a7-1039-4c6a-bb6b-5831575c06ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d6b9fc-89f4-4612-a0f6-46ca81196da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:53 devstack sudo[105161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec 1073741824
Nov 03 08:17:53 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:53 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Volume volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd (d69c58f4-e9d5-4a18-bb75-2ba310e090cd): created successfully
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d6b9fc-89f4-4612-a0f6-46ca81196da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Flow 'volume_create_manager' (43252fa0-ff14-4bc1-9e25-d297ca71bfe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:53 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-89868414-2506-4f6d-b77f-7c1da944dc0c tempest-CreateVolumesFromImageTest-1386802009 None] Created volume successfully.
Nov 03 08:17:53 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec 1073741824" returned: 0 in 0.452s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:53 devstack sudo[105167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec
Nov 03 08:17:53 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:53 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec" returned: 0 in 0.252s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902843798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b420eb-bbf5-477a-a87e-7b61ec30f4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203dfdf76c246bc823f00e4de44ad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:52Z,use_quota=True,user_id='d09a918faf2e4c5b8d0052e35ef52c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Creating volume e1b420eb-bbf5-477a-a87e-7b61ec30f4f3 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:17:53 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ec9554-4ef5-4f95-8966-40b9fe3e84a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:53 devstack sudo[105170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3 1073741824
Nov 03 08:17:53 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dca2d4a-a609-467e-9dd6-af76a1b5a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:53 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Volume volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec (68873bfa-c7b8-4709-9cf7-5a5d8e3110ec): created successfully
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dca2d4a-a609-467e-9dd6-af76a1b5a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Flow 'volume_create_manager' (91e2c9ac-8568-4de6-ba4d-59381ae8040a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:53 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-704faba4-9cc4-4654-a7f6-5004460769dc tempest-CreateVolumesFromImageTest-1386802009 None] Created volume successfully.
Nov 03 08:17:54 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3 1073741824" returned: 0 in 0.530s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:54 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3
Nov 03 08:17:54 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:54 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3" returned: 0 in 0.237s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:17:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b33067b-ff6b-4b3f-9696-7096c511c462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed31caa4-72c8-4a8c-8677-e0746fa3fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:17:54 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Volume volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3 (e1b420eb-bbf5-477a-a87e-7b61ec30f4f3): created successfully
Nov 03 08:17:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed31caa4-72c8-4a8c-8677-e0746fa3fc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:17:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Flow 'volume_create_manager' (6b9df50d-ba1e-4b87-b0bd-df6c831e8e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:17:54 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a40543b5-806f-4d31-923d-42e5ac679f9a tempest-CreateVolumesFromImageTest-1386802009 None] Created volume successfully.
Nov 03 08:17:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "cinder-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "cinder-quobyte-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-quobyte-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:55 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[76296052-36f2-4d96-8022-eea542c980a3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:55 devstack sudo[105179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3
Nov 03 08:17:55 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:55 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3" returned: 0 in 0.359s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:55 devstack sudo[105184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3
Nov 03 08:17:55 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:56 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3" returned: 0 in 0.246s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-quobyte-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3" released by "delete_volume" :: held 0.649s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Created reservations ['345106f1-c685-4580-80e5-da7788e41226', '8f2fcc72-b65e-4f43-80f8-0c1fcd37085e', '5c7d7640-5403-4dca-bdbd-763cba89227b', '1b8c4864-41c8-44d2-9e14-88f9ff3f20a3'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:56 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:56 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:56 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.284s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "cinder-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:56 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Deleted volume successfully.
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b64c95de-a7b0-41e8-b710-4ee31ad69fc8 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-e1b420eb-bbf5-477a-a87e-7b61ec30f4f3-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "cinder-quobyte-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-quobyte-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0063e0ee-7e8e-4be8-927b-553d306ae7a8]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:56 devstack sudo[105190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec
Nov 03 08:17:56 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:57 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec" returned: 0 in 0.370s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:57 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec
Nov 03 08:17:57 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:57 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec" returned: 0 in 0.298s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-quobyte-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec" released by "delete_volume" :: held 0.709s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Created reservations ['c4ee8a3d-8a6e-421d-b21e-a8eb7de8ff68', '4a746c45-2c8c-4729-b58c-8e342f0cd742', '89e7e334-30b0-4eb7-aeb7-7270792b37c6', 'eb2892cd-4413-419d-b795-edf9b9e43c72'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:57 devstack sudo[105198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:57 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:57 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "cinder-d69c58f4-e9d5-4a18-bb75-2ba310e090cd-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.285s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:17:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Deleted volume successfully.
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-d69c58f4-e9d5-4a18-bb75-2ba310e090cd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a76cee0c-98ed-45e1-a0b0-a3735315c61d tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-68873bfa-c7b8-4709-9cf7-5a5d8e3110ec-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "cinder-quobyte-d69c58f4-e9d5-4a18-bb75-2ba310e090cd" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-quobyte-d69c58f4-e9d5-4a18-bb75-2ba310e090cd" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15742bb-7d96-4ab7-b0e5-20b16595bcd3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:58 devstack sudo[105201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd
Nov 03 08:17:58 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:58 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd" returned: 0 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:58 devstack sudo[105207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd
Nov 03 08:17:58 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:58 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-d69c58f4-e9d5-4a18-bb75-2ba310e090cd" returned: 0 in 0.263s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-quobyte-d69c58f4-e9d5-4a18-bb75-2ba310e090cd" released by "delete_volume" :: held 0.695s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Created reservations ['4615269b-5d6c-4049-a67f-69eb48645417', 'abe420b3-e9e9-4631-b66f-7d43d717896f', 'f6690fea-11c1-43a1-bbef-b3187814f3e2', '2c3451f6-4623-4e1b-8b12-5c545c625013'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:58 devstack sudo[105210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:58 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:58 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.268s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:17:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Deleted volume successfully.
Nov 03 08:17:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "cinder-7d5cc72f-4883-49d8-84a6-8954de8ae6bf-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-7d5cc72f-4883-49d8-84a6-8954de8ae6bf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1a12f461-40c6-42c2-a1eb-6fae261215c6 tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-d69c58f4-e9d5-4a18-bb75-2ba310e090cd-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "cinder-quobyte-7d5cc72f-4883-49d8-84a6-8954de8ae6bf" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-quobyte-7d5cc72f-4883-49d8-84a6-8954de8ae6bf" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[801b84db-7945-488a-9bdc-7d1fe9a4c8fa]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:59 devstack sudo[105213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf
Nov 03 08:17:59 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:59 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf" returned: 0 in 0.414s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:59 devstack sudo[105218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf
Nov 03 08:17:59 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:17:59 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d5cc72f-4883-49d8-84a6-8954de8ae6bf" returned: 0 in 0.269s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-quobyte-7d5cc72f-4883-49d8-84a6-8954de8ae6bf" released by "delete_volume" :: held 0.732s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Created reservations ['26a36327-eec2-41e7-9e4f-c2c1ba8a5e11', 'b033e422-76a7-4f6d-bb94-273d0c2f2637', '698a649b-9643-4a35-8b49-76c2b5874afb', 'eb1ab2b3-3915-482e-8aee-048684a8a4f5'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:17:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:17:59 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:17:59 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:00 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "cinder-9a5377ea-953b-40e4-9f74-296ffa92961a-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.325s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:00 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Deleted volume successfully.
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-9a5377ea-953b-40e4-9f74-296ffa92961a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-af25c55f-35d2-4814-9d83-aa6feecdfbed tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-7d5cc72f-4883-49d8-84a6-8954de8ae6bf-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "cinder-quobyte-9a5377ea-953b-40e4-9f74-296ffa92961a" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-quobyte-9a5377ea-953b-40e4-9f74-296ffa92961a" acquired by "delete_volume" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edbfd83-7254-4258-bd86-71f23bcefa33]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:00 devstack sudo[105224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a
Nov 03 08:18:00 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:00 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a" returned: 0 in 0.370s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:00 devstack sudo[105229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a
Nov 03 08:18:00 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:01 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-9a5377ea-953b-40e4-9f74-296ffa92961a" returned: 0 in 0.265s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-quobyte-9a5377ea-953b-40e4-9f74-296ffa92961a" released by "delete_volume" :: held 0.692s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Created reservations ['84740b06-1f08-495d-8416-12292a99f439', 'cbb3ea02-cbd0-4d6d-9888-a6f5a580605b', '33f86717-dcd4-4e0e-ba3b-6893b75e115f', '9d589211-297e-459f-a35c-ca83c1b77d7e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:01 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:18:01 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:01 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Deleted volume successfully.
Nov 03 08:18:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2f54c4aa-45a5-4176-9aa3-33b278f55ffe tempest-CreateVolumesFromImageTest-1386802009 None] Lock "cinder-9a5377ea-953b-40e4-9f74-296ffa92961a-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:03 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:18:03 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:03 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.311s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:18:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (67ca0ef2-ca8c-4b69-bad9-66e043b5b7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cb5a5d-191e-44af-82e0-310290df2829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cb5a5d-191e-44af-82e0-310290df2829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1196804100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171debac-5aa6-4744-9cb0-ea200582445c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:05Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114ae3b1-0240-4644-be2f-a5558f4ee04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114ae3b1-0240-4644-be2f-a5558f4ee04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa791460-4227-4134-9688-2602cd2ea75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa791460-4227-4134-9688-2602cd2ea75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171debac-5aa6-4744-9cb0-ea200582445c', 'volume_name': 'volume-171debac-5aa6-4744-9cb0-ea200582445c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fd2995-29ed-4485-914f-4e59d57b54ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fd2995-29ed-4485-914f-4e59d57b54ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a32b9c8-f63b-4f35-aa30-a45b50bc30a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:04 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume 171debac-5aa6-4744-9cb0-ea200582445c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171debac-5aa6-4744-9cb0-ea200582445c', 'volume_size': 1}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1196804100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171debac-5aa6-4744-9cb0-ea200582445c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:05Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Creating volume 171debac-5aa6-4744-9cb0-ea200582445c {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:04 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:04 devstack sudo[105239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c 1073741824
Nov 03 08:18:04 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:05 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c 1073741824" returned: 0 in 0.428s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:05 devstack sudo[105245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c
Nov 03 08:18:05 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:05 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c" returned: 0 in 0.242s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a32b9c8-f63b-4f35-aa30-a45b50bc30a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171debac-5aa6-4744-9cb0-ea200582445c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a651d0da-6097-44f1-a6da-63cd5d62204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume volume-171debac-5aa6-4744-9cb0-ea200582445c (171debac-5aa6-4744-9cb0-ea200582445c): created successfully
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a651d0da-6097-44f1-a6da-63cd5d62204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (67ca0ef2-ca8c-4b69-bad9-66e043b5b7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:05 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f2fab2dc-832e-436d-880c-7c5084b748d9 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created volume successfully.
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Creating offline snapshot 21a1334c-89d1-4b84-b746-28253b8abdfa of volume 171debac-5aa6-4744-9cb0-ea200582445c {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b464426c-626c-4d57-91da-a10e6c832d42]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:06 devstack sudo[105248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c
Nov 03 08:18:06 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:06 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c" returned: 0 in 0.414s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:06 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa 1G
Nov 03 08:18:06 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:06 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa 1G" returned: 0 in 0.427s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-171debac-5aa6-4744-9cb0-ea200582445c -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:06 devstack sudo[105261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-171debac-5aa6-4744-9cb0-ea200582445c -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa
Nov 03 08:18:06 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:07 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-171debac-5aa6-4744-9cb0-ea200582445c -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa" returned: 0 in 0.315s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:07 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa is being set with open permissions: ugo+rw
Nov 03 08:18:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:07 devstack sudo[105267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa
Nov 03 08:18:07 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:07 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:07 devstack sudo[105270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.info
Nov 03 08:18:07 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:07 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.info" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:07 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.info is being set with open permissions: ugo+rw
Nov 03 08:18:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:07 devstack sudo[105273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.info
Nov 03 08:18:07 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:07 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.info" returned: 0 in 0.259s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:07 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3cf19bd1-038a-4ca9-aa8a-167a51697f7a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Create snapshot completed successfully
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (5f95e79e-2714-4542-8fca-cd407e45e927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df769213-12a1-4128-a008-6a593fed7f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df769213-12a1-4128-a008-6a593fed7f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-81166260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb10a79-f7f3-4aa8-9b02-c2113799d753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:09Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d7562c-7c4e-4e1d-a5eb-ae07f86fe711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d7562c-7c4e-4e1d-a5eb-ae07f86fe711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289a19a0-5d7b-4222-8007-356441a26e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289a19a0-5d7b-4222-8007-356441a26e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb10a79-f7f3-4aa8-9b02-c2113799d753', 'volume_name': 'volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a337e465-7f71-4ded-917f-e62fb72d40c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a337e465-7f71-4ded-917f-e62fb72d40c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9b4bd9-81f7-419e-bfe7-9e2e5d38c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:09 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume bcb10a79-f7f3-4aa8-9b02-c2113799d753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753', 'volume_size': 1}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-81166260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb10a79-f7f3-4aa8-9b02-c2113799d753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:09Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Creating volume bcb10a79-f7f3-4aa8-9b02-c2113799d753 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:09 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:09 devstack sudo[105276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753 1073741824
Nov 03 08:18:09 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (ef6e19e0-0fba-407a-b016-03c833f92472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8b697d-224f-4412-b695-00df717c4e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8b697d-224f-4412-b695-00df717c4e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2055677060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507640ac-443c-4dc5-b205-e8be6cf7027c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:10Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2f6222-6c44-4410-889c-53f8966a9fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2f6222-6c44-4410-889c-53f8966a9fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927ce3f8-5ce1-4b9b-8835-bf4310852058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927ce3f8-5ce1-4b9b-8835-bf4310852058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507640ac-443c-4dc5-b205-e8be6cf7027c', 'volume_name': 'volume-507640ac-443c-4dc5-b205-e8be6cf7027c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297c8d2f-372f-4a71-abc4-ea0f08ba8b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297c8d2f-372f-4a71-abc4-ea0f08ba8b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b96358-9f45-4721-9655-21c222a0c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:09 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume 507640ac-443c-4dc5-b205-e8be6cf7027c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507640ac-443c-4dc5-b205-e8be6cf7027c', 'volume_size': 1}
Nov 03 08:18:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:10 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753 1073741824" returned: 0 in 0.608s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:10 devstack sudo[105282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753
Nov 03 08:18:10 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (4c255c8f-c529-42bc-9b15-bc04f3afddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27444859-451f-410e-90d5-7c6e5d73b365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27444859-451f-410e-90d5-7c6e5d73b365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543909632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076e80fc-5f9e-417f-9418-0a0831b2e289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:10Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a77678-cfcc-4602-a434-36dc01baec31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a77678-cfcc-4602-a434-36dc01baec31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95ba6d2-956c-4660-8e8d-1f5aff8a3128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95ba6d2-956c-4660-8e8d-1f5aff8a3128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '076e80fc-5f9e-417f-9418-0a0831b2e289', 'volume_name': 'volume-076e80fc-5f9e-417f-9418-0a0831b2e289', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2256055c-097c-4e75-9d13-24c817fec1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2256055c-097c-4e75-9d13-24c817fec1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37741b3d-3485-4ee5-8403-c9ed0f8ece90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume 076e80fc-5f9e-417f-9418-0a0831b2e289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-076e80fc-5f9e-417f-9418-0a0831b2e289', 'volume_size': 1}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:10 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753" returned: 0 in 0.262s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2055677060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507640ac-443c-4dc5-b205-e8be6cf7027c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:10Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Creating volume 507640ac-443c-4dc5-b205-e8be6cf7027c {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:10 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:10 devstack sudo[105285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c 1073741824
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9b4bd9-81f7-419e-bfe7-9e2e5d38c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:10 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37061984-5135-4402-b52a-ba4a8bb29a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753 (bcb10a79-f7f3-4aa8-9b02-c2113799d753): created successfully
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37061984-5135-4402-b52a-ba4a8bb29a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (5f95e79e-2714-4542-8fca-cd407e45e927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-57db5898-f2b9-44d3-a0b6-c37a1259633d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created volume successfully.
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (71244476-8ad1-4647-bd53-16e5a21ad0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b049822b-d08a-4425-8617-38485e1921a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b049822b-d08a-4425-8617-38485e1921a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1570583854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898ee14d-2884-45cb-b6f4-93ca82597dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:11Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564836d2-81bb-4c43-8f21-776ef82c3c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564836d2-81bb-4c43-8f21-776ef82c3c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384a225f-5fe2-493e-ab83-8707a4f51f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384a225f-5fe2-493e-ab83-8707a4f51f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898ee14d-2884-45cb-b6f4-93ca82597dc3', 'volume_name': 'volume-898ee14d-2884-45cb-b6f4-93ca82597dc3', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381eaaf7-6755-40b3-be5e-f309e5c6069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381eaaf7-6755-40b3-be5e-f309e5c6069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24996b2c-cce1-4f03-89d5-5161b8d99bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:10 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume 898ee14d-2884-45cb-b6f4-93ca82597dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898ee14d-2884-45cb-b6f4-93ca82597dc3', 'volume_size': 1}
Nov 03 08:18:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:11 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c 1073741824" returned: 0 in 0.679s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:11 devstack sudo[105291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c
Nov 03 08:18:11 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (3a6c530d-a428-4053-9769-c232d8f34274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50d2a60-6d28-4874-b66b-aaeb6ba9c5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50d2a60-6d28-4874-b66b-aaeb6ba9c5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1329200707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6caa772d-9ecc-4790-b985-5cfd66fc86da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:11Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167f2728-b017-4267-808f-75050c77270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167f2728-b017-4267-808f-75050c77270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98398e40-b224-49b3-a179-55b0d3f41c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98398e40-b224-49b3-a179-55b0d3f41c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6caa772d-9ecc-4790-b985-5cfd66fc86da', 'volume_name': 'volume-6caa772d-9ecc-4790-b985-5cfd66fc86da', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c990ffbe-c62f-456f-ac92-d93de23f8179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c990ffbe-c62f-456f-ac92-d93de23f8179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0b314c-0c49-44f9-8875-d42c1b57ce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:11 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume 6caa772d-9ecc-4790-b985-5cfd66fc86da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6caa772d-9ecc-4790-b985-5cfd66fc86da', 'volume_size': 1}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:11 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c" returned: 0 in 0.278s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543909632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076e80fc-5f9e-417f-9418-0a0831b2e289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:10Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Creating volume 076e80fc-5f9e-417f-9418-0a0831b2e289 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:11 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:11 devstack sudo[105294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289 1073741824
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b96358-9f45-4721-9655-21c222a0c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507640ac-443c-4dc5-b205-e8be6cf7027c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:11 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14364157-c881-4c39-aa75-d0791e590e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:11 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume volume-507640ac-443c-4dc5-b205-e8be6cf7027c (507640ac-443c-4dc5-b205-e8be6cf7027c): created successfully
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14364157-c881-4c39-aa75-d0791e590e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (ef6e19e0-0fba-407a-b016-03c833f92472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-673d27b3-f8ec-42a6-89ca-0b9a5023b62d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created volume successfully.
Nov 03 08:18:11 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289 1073741824" returned: 0 in 0.460s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:12 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289
Nov 03 08:18:12 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:12 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289" returned: 0 in 0.298s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1570583854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898ee14d-2884-45cb-b6f4-93ca82597dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:11Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Creating volume 898ee14d-2884-45cb-b6f4-93ca82597dc3 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:12 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37741b3d-3485-4ee5-8403-c9ed0f8ece90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-076e80fc-5f9e-417f-9418-0a0831b2e289', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaca404-16eb-4189-b7f2-7411d7ef119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:12 devstack sudo[105303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3 1073741824
Nov 03 08:18:12 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:12 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume volume-076e80fc-5f9e-417f-9418-0a0831b2e289 (076e80fc-5f9e-417f-9418-0a0831b2e289): created successfully
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaca404-16eb-4189-b7f2-7411d7ef119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (4c255c8f-c529-42bc-9b15-bc04f3afddff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9e502b0d-590b-4232-b8a7-b6fa2969ab25 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created volume successfully.
Nov 03 08:18:12 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3 1073741824" returned: 0 in 0.521s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:12 devstack sudo[105309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3
Nov 03 08:18:12 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:13 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3" returned: 0 in 0.307s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.826s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1329200707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6caa772d-9ecc-4790-b985-5cfd66fc86da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b93bf891e841ff9f5a366665bb5ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:11Z,use_quota=True,user_id='2d680c3c89c34729847a09598fdfa48b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Creating volume 6caa772d-9ecc-4790-b985-5cfd66fc86da {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:13 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24996b2c-cce1-4f03-89d5-5161b8d99bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898ee14d-2884-45cb-b6f4-93ca82597dc3', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445d3db2-07b9-46b6-bc69-e85b2dd490a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:13 devstack sudo[105312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da 1073741824
Nov 03 08:18:13 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume volume-898ee14d-2884-45cb-b6f4-93ca82597dc3 (898ee14d-2884-45cb-b6f4-93ca82597dc3): created successfully
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445d3db2-07b9-46b6-bc69-e85b2dd490a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (71244476-8ad1-4647-bd53-16e5a21ad0c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-728150d6-e5d5-473e-96bd-8e211bbcf942 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created volume successfully.
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Flow 'volume_create_manager' (a56b80f5-cb14-4d1f-a034-31fd380f9b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbed4bf-86c0-40fe-a486-fade438734be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbed4bf-86c0-40fe-a486-fade438734be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-998940025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d59a6f-6808-4804-92c6-d4f1db25bea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4478cb098f7b4ef382bd5336898d22b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:14Z,use_quota=True,user_id='eeb6d84bbcc04a31b9545d976829c2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd9513d-153b-46a6-93b2-53003befb9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd9513d-153b-46a6-93b2-53003befb9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13361fc6-ac7a-49ac-98cd-54ecd58890d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13361fc6-ac7a-49ac-98cd-54ecd58890d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d59a6f-6808-4804-92c6-d4f1db25bea5', 'volume_name': 'volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e45b058-c0c6-45d5-8898-7d5e513d8a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e45b058-c0c6-45d5-8898-7d5e513d8a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669cfc34-1ee0-44d0-a9f9-7130973d28ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Volume f6d59a6f-6808-4804-92c6-d4f1db25bea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5', 'volume_size': 1}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:13 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da 1073741824" returned: 0 in 0.491s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:13 devstack sudo[105318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da
Nov 03 08:18:13 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:13 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da" returned: 0 in 0.235s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-998940025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d59a6f-6808-4804-92c6-d4f1db25bea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4478cb098f7b4ef382bd5336898d22b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:14Z,use_quota=True,user_id='eeb6d84bbcc04a31b9545d976829c2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Creating volume f6d59a6f-6808-4804-92c6-d4f1db25bea5 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:13 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0b314c-0c49-44f9-8875-d42c1b57ce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6caa772d-9ecc-4790-b985-5cfd66fc86da', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba59ea90-9517-42c3-8087-6e29e691bf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:14 devstack sudo[105321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 1073741824
Nov 03 08:18:14 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:14 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Volume volume-6caa772d-9ecc-4790-b985-5cfd66fc86da (6caa772d-9ecc-4790-b985-5cfd66fc86da): created successfully
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba59ea90-9517-42c3-8087-6e29e691bf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Flow 'volume_create_manager' (3a6c530d-a428-4053-9769-c232d8f34274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:14 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ea028268-a601-4e53-8409-8d598cb9bf1a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created volume successfully.
Nov 03 08:18:14 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 1073741824" returned: 0 in 0.424s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:14 devstack sudo[105327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5
Nov 03 08:18:14 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-6caa772d-9ecc-4790-b985-5cfd66fc86da-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-6caa772d-9ecc-4790-b985-5cfd66fc86da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:14 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-quobyte-6caa772d-9ecc-4790-b985-5cfd66fc86da" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5" returned: 0 in 0.282s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-6caa772d-9ecc-4790-b985-5cfd66fc86da" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669cfc34-1ee0-44d0-a9f9-7130973d28ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf535a64-a9eb-4a76-a81a-0c0d85393b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3c3e99-53fc-48dd-82f4-d5fe83d15159]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:14 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Volume volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 (f6d59a6f-6808-4804-92c6-d4f1db25bea5): created successfully
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf535a64-a9eb-4a76-a81a-0c0d85393b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Flow 'volume_create_manager' (a56b80f5-cb14-4d1f-a034-31fd380f9b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:14 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-89bb0acd-f38c-4e1c-a155-356a3e43f25f tempest-SnapshotDependencyTests-1494913754 None] Created volume successfully.
Nov 03 08:18:14 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da
Nov 03 08:18:14 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:15 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da" returned: 0 in 0.355s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:15 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da
Nov 03 08:18:15 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:15 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6caa772d-9ecc-4790-b985-5cfd66fc86da" returned: 0 in 0.241s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-6caa772d-9ecc-4790-b985-5cfd66fc86da" released by "delete_volume" :: held 0.640s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created reservations ['73e4598e-7f8e-40df-a11d-789adc772b97', '8b2825f6-2420-4ec4-ada1-07bcfae5f511', 'b6be1ba5-5189-4b08-a55e-2aa058bb1b07', '1a5d3abd-df2b-4948-88eb-a6b1a5102b93'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:15 devstack sudo[105338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:18:15 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:15 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.254s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:15 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Deleted volume successfully.
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-edb095d7-c40e-4f2b-90ce-303243f00745 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-6caa772d-9ecc-4790-b985-5cfd66fc86da-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-898ee14d-2884-45cb-b6f4-93ca82597dc3-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-898ee14d-2884-45cb-b6f4-93ca82597dc3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-quobyte-898ee14d-2884-45cb-b6f4-93ca82597dc3" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Creating offline snapshot 9a25c2fb-300f-428a-ba76-956cbecbb47e of volume f6d59a6f-6808-4804-92c6-d4f1db25bea5 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-898ee14d-2884-45cb-b6f4-93ca82597dc3" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7acc44-2b9d-484e-9258-4fccc75c6e2f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce542d53-bcca-441b-b123-83f0c876768a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:16 devstack sudo[105342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5
Nov 03 08:18:16 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:16 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3
Nov 03 08:18:16 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:16 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:16 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5" returned: 0 in 0.401s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3" returned: 0 in 0.392s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:16 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e 1G
Nov 03 08:18:16 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:16 devstack sudo[105356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3
Nov 03 08:18:16 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:16 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-898ee14d-2884-45cb-b6f4-93ca82597dc3" returned: 0 in 0.253s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-898ee14d-2884-45cb-b6f4-93ca82597dc3" released by "delete_volume" :: held 0.701s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created reservations ['74144a20-d28d-42ea-81aa-dbeaf04ea97b', '831ee3f9-19ea-4489-8cb1-fff972787cde', '585a9778-d492-4f08-8553-7d0fd648eaad', '5e8aadd0-3a96-4a4f-8749-b56d1248e070'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:16 devstack sudo[105363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:18:16 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:16 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e 1G" returned: 0 in 0.432s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:16 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e
Nov 03 08:18:16 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:16 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.248s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:16 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Deleted volume successfully.
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-076e80fc-5f9e-417f-9418-0a0831b2e289-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-076e80fc-5f9e-417f-9418-0a0831b2e289-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0bf60b6e-ac4d-4061-9299-4106283c9f3b tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-898ee14d-2884-45cb-b6f4-93ca82597dc3-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-quobyte-076e80fc-5f9e-417f-9418-0a0831b2e289" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-076e80fc-5f9e-417f-9418-0a0831b2e289" acquired by "delete_volume" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:17 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e" returned: 0 in 0.327s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:17 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e is being set with open permissions: ugo+rw
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e990d02-a70d-40cd-ba67-d3900ac4094f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:17 devstack sudo[105371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e
Nov 03 08:18:17 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:17 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289
Nov 03 08:18:17 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:17 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:17 devstack sudo[105376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.info
Nov 03 08:18:17 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:17 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289" returned: 0 in 0.399s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:17 devstack sudo[105381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289
Nov 03 08:18:17 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:17 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.info" returned: 0 in 0.255s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:17 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.info is being set with open permissions: ugo+rw
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:17 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.info
Nov 03 08:18:17 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:17 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-076e80fc-5f9e-417f-9418-0a0831b2e289" returned: 0 in 0.257s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-076e80fc-5f9e-417f-9418-0a0831b2e289" released by "delete_volume" :: held 0.710s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created reservations ['763d061b-3508-4e6a-847c-ca8cba80f066', 'f1b2ac80-f488-4451-b1a3-f1f356f8f97b', '91ec850a-b3fc-4729-b0c9-87b751c702a4', '286434be-7626-42d6-8d35-59975b16ccae'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:17 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.info" returned: 0 in 0.261s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:17 devstack sudo[105388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:18:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a2866987-bead-4cce-b68a-0b1886399f62 tempest-SnapshotDependencyTests-1494913754 None] Create snapshot completed successfully
Nov 03 08:18:17 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-507640ac-443c-4dc5-b205-e8be6cf7027c-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:18 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.258s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-507640ac-443c-4dc5-b205-e8be6cf7027c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Deleted volume successfully.
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f5c60e1d-6e70-4e5a-a575-61582425621a tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-076e80fc-5f9e-417f-9418-0a0831b2e289-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-quobyte-507640ac-443c-4dc5-b205-e8be6cf7027c" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-507640ac-443c-4dc5-b205-e8be6cf7027c" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc067ff-6fc8-494f-88f3-391a5c49794a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:18 devstack sudo[105393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c
Nov 03 08:18:18 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:18 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c" returned: 0 in 0.359s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:18 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c
Nov 03 08:18:18 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:18 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-507640ac-443c-4dc5-b205-e8be6cf7027c" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-507640ac-443c-4dc5-b205-e8be6cf7027c" released by "delete_volume" :: held 0.651s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created reservations ['03f5b2b9-d185-4ab2-b459-48167d017be3', '2ea44f21-c2da-4560-bc26-80bfd4eb266c', '81996a59-6005-4f75-b905-bfc77f39d6ab', '6fd5e773-80d4-4d78-b2c1-e52608baa025'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:19 devstack sudo[105407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:18:19 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:19 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.265s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:19 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Deleted volume successfully.
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-bcb10a79-f7f3-4aa8-9b02-c2113799d753-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-3bc07890-4a9c-438d-822b-ff6d838119c7 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-507640ac-443c-4dc5-b205-e8be6cf7027c-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-bcb10a79-f7f3-4aa8-9b02-c2113799d753-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-quobyte-bcb10a79-f7f3-4aa8-9b02-c2113799d753" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-bcb10a79-f7f3-4aa8-9b02-c2113799d753" acquired by "delete_volume" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fa3882-566d-4e6e-beb4-00b747c53978]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:19 devstack sudo[105410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753
Nov 03 08:18:19 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Flow 'volume_create_manager' (356ea7cf-23ac-43a3-9061-33285bfb2459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2671fe-078d-48f5-81e8-ac6e5f134040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2671fe-078d-48f5-81e8-ac6e5f134040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0158a850-133e-4eb7-8387-9e6bb0363aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4478cb098f7b4ef382bd5336898d22b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a25c2fb-300f-428a-ba76-956cbecbb47e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:20Z,use_quota=True,user_id='eeb6d84bbcc04a31b9545d976829c2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a075aebc-1842-4d6f-8a9c-9fe738f96df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a075aebc-1842-4d6f-8a9c-9fe738f96df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095678b9-750f-4911-bb63-997f7aaf1e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095678b9-750f-4911-bb63-997f7aaf1e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0158a850-133e-4eb7-8387-9e6bb0363aa8', 'volume_name': 'volume-0158a850-133e-4eb7-8387-9e6bb0363aa8', 'volume_size': 1, 'snapshot_id': '9a25c2fb-300f-428a-ba76-956cbecbb47e'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c936cd48-2ad9-4757-8eb0-3e78028e05f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c936cd48-2ad9-4757-8eb0-3e78028e05f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1392cc0a-fdc0-4707-ae93-93ad5eaf277d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:19 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Volume 0158a850-133e-4eb7-8387-9e6bb0363aa8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0158a850-133e-4eb7-8387-9e6bb0363aa8', 'volume_size': 1, 'snapshot_id': '9a25c2fb-300f-428a-ba76-956cbecbb47e'}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "cinder-quobyte-9a25c2fb-300f-428a-ba76-956cbecbb47e-0158a850-133e-4eb7-8387-9e6bb0363aa8" by "_create_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-9a25c2fb-300f-428a-ba76-956cbecbb47e-0158a850-133e-4eb7-8387-9e6bb0363aa8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Creating volume 0158a850-133e-4eb7-8387-9e6bb0363aa8 from snapshot 9a25c2fb-300f-428a-ba76-956cbecbb47e {{(pid=86851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "cinder-quobyte-0158a850-133e-4eb7-8387-9e6bb0363aa8" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-0158a850-133e-4eb7-8387-9e6bb0363aa8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] snapshot: 9a25c2fb-300f-428a-ba76-956cbecbb47e, volume: 0158a850-133e-4eb7-8387-9e6bb0363aa8,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd5f5ce-3e28-4b1b-a438-2f901eedcb3e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:19 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753" returned: 0 in 0.378s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:19 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753
Nov 03 08:18:19 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:19 devstack sudo[105416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e
Nov 03 08:18:19 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:20 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bcb10a79-f7f3-4aa8-9b02-c2113799d753" returned: 0 in 0.249s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-bcb10a79-f7f3-4aa8-9b02-c2113799d753" released by "delete_volume" :: held 0.691s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created reservations ['815cca80-b604-4d7f-a898-35dbdafd6f6c', '427f16c1-0299-48bd-8c2b-4f27ce8969d6', 'c5a65a36-6b15-4794-be8c-aac391c585c3', '2375c966-83ee-4e10-ae24-8f25457ee2da'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:20 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e" returned: 0 in 0.380s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[743adc42-e10e-4ca4-a292-0cd1ae0c9a10]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:20 devstack sudo[105425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:18:20 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:20 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5
Nov 03 08:18:20 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-21a1334c-89d1-4b84-b746-28253b8abdfa-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:20 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.265s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:20 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Deleted volume successfully.
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-21a1334c-89d1-4b84-b746-28253b8abdfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-quobyte-171debac-5aa6-4744-9cb0-ea200582445c" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-171debac-5aa6-4744-9cb0-ea200582445c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-quobyte-21a1334c-89d1-4b84-b746-28253b8abdfa" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8fd5c4d4-6618-45d1-9f7e-930aea26da0d tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-bcb10a79-f7f3-4aa8-9b02-c2113799d753-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-21a1334c-89d1-4b84-b746-28253b8abdfa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Deleting offline snapshot 21a1334c-89d1-4b84-b746-28253b8abdfa of volume 171debac-5aa6-4744-9cb0-ea200582445c {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] snapshot_file for this snap is: volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b39158-40f1-4264-a986-92362cd91d87]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:20 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5" returned: 0 in 0.429s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8 not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:18:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:20 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8
Nov 03 08:18:20 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:20 devstack sudo[105432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa
Nov 03 08:18:20 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:21 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa" returned: 0 in 0.396s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-171debac-5aa6-4744-9cb0-ea200582445c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:18:21 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[696a0efa-cb22-49f5-b13b-8ef03a424623]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:21 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c
Nov 03 08:18:21 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:21 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c" returned: 0 in 0.573s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:21 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa
Nov 03 08:18:21 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:22 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa" returned: 0 in 0.557s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:22 devstack sudo[105461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa
Nov 03 08:18:22 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:22 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c.21a1334c-89d1-4b84-b746-28253b8abdfa" returned: 0 in 0.356s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-21a1334c-89d1-4b84-b746-28253b8abdfa" released by "_delete_snapshot" :: held 2.047s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-171debac-5aa6-4744-9cb0-ea200582445c" released by "delete_snapshot" :: held 2.087s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:22 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created reservations ['e4abea4d-81d8-443d-b67d-da35bd859d59', '3f0df000-97af-4104-8f49-c28ec80fc57e', 'a647612f-dc36-4ae8-989e-68b4bcca6876', 'c97783d0-8b78-43f8-a36c-aca05176ec1f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Delete snapshot completed successfully.
Nov 03 08:18:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-65e883b4-eaa7-4a9d-acba-3f38f6af9045 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-21a1334c-89d1-4b84-b746-28253b8abdfa-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-171debac-5aa6-4744-9cb0-ea200582445c-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-171debac-5aa6-4744-9cb0-ea200582445c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "cinder-quobyte-171debac-5aa6-4744-9cb0-ea200582445c" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-171debac-5aa6-4744-9cb0-ea200582445c" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:24 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[97556aa6-9301-4642-8e07-cd65142c59d9]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:24 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c
Nov 03 08:18:24 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:24 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c" returned: 0 in 0.484s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:24 devstack sudo[105470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c
Nov 03 08:18:24 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:25 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-171debac-5aa6-4744-9cb0-ea200582445c" returned: 0 in 0.448s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-quobyte-171debac-5aa6-4744-9cb0-ea200582445c" released by "delete_volume" :: held 1.070s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Created reservations ['13e19254-4f78-4b95-a935-95f3246d018c', '79523009-cbba-4d1d-879c-1880892df7fb', '65360e82-012c-4e50-84b8-4749e3d9022b', 'f9550468-de9a-4261-b22d-401b57bd515a'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:25 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:18:25 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:25 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.376s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Deleted volume successfully.
Nov 03 08:18:25 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e0b554b0-17c2-4e4f-b1ba-3d16abaf9db0 tempest-CreateVolumesFromSnapshotTest-1653391493 None] Lock "cinder-171debac-5aa6-4744-9cb0-ea200582445c-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:27 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8" returned: 0 in 6.523s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:18:27 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Converted 1024.00 MB image at 156.97 MB/s
Nov 03 08:18:27 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8 is being set with open permissions: ugo+rw
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:27 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8
Nov 03 08:18:27 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:27 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8" returned: 0 in 0.258s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-0158a850-133e-4eb7-8387-9e6bb0363aa8" released by "_copy_volume_from_snapshot" :: held 7.674s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-9a25c2fb-300f-428a-ba76-956cbecbb47e-0158a850-133e-4eb7-8387-9e6bb0363aa8" released by "_create_volume_from_snapshot" :: held 7.736s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.753s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1392cc0a-fdc0-4707-ae93-93ad5eaf277d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0158a850-133e-4eb7-8387-9e6bb0363aa8', 'volume_size': 1, 'snapshot_id': '9a25c2fb-300f-428a-ba76-956cbecbb47e'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d97990-206a-4154-a9fe-69e8a9e630aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:27 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Volume volume-0158a850-133e-4eb7-8387-9e6bb0363aa8 (0158a850-133e-4eb7-8387-9e6bb0363aa8): created successfully
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d97990-206a-4154-a9fe-69e8a9e630aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Flow 'volume_create_manager' (356ea7cf-23ac-43a3-9061-33285bfb2459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:27 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d9f1cbd0-a953-405f-af66-805437a5d39e tempest-SnapshotDependencyTests-1494913754 None] Created volume successfully.
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "cinder-9a25c2fb-300f-428a-ba76-956cbecbb47e-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-9a25c2fb-300f-428a-ba76-956cbecbb47e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "cinder-quobyte-f6d59a6f-6808-4804-92c6-d4f1db25bea5" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-f6d59a6f-6808-4804-92c6-d4f1db25bea5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "cinder-quobyte-9a25c2fb-300f-428a-ba76-956cbecbb47e" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-9a25c2fb-300f-428a-ba76-956cbecbb47e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Deleting offline snapshot 9a25c2fb-300f-428a-ba76-956cbecbb47e of volume f6d59a6f-6808-4804-92c6-d4f1db25bea5 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] snapshot_file for this snap is: volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7818c1-65a0-431f-9232-4de52135433e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:28 devstack sudo[105479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e
Nov 03 08:18:28 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:28 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e" returned: 0 in 0.344s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4714075-53f4-422a-94ac-738c5b68ccd8]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:28 devstack sudo[105484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5
Nov 03 08:18:28 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:29 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5" returned: 0 in 0.511s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:29 devstack sudo[105489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e
Nov 03 08:18:29 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:29 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e" returned: 0 in 0.317s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:29 devstack sudo[105495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e
Nov 03 08:18:29 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:29 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5.9a25c2fb-300f-428a-ba76-956cbecbb47e" returned: 0 in 0.231s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:29 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=132,cinder:UPDATE=182,cinder:DELETE=15,cinder:INSERT=45 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:18:29 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=125,cinder:UPDATE=193,cinder:INSERT=42,cinder:DELETE=20 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:18:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-9a25c2fb-300f-428a-ba76-956cbecbb47e" released by "_delete_snapshot" :: held 1.508s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-f6d59a6f-6808-4804-92c6-d4f1db25bea5" released by "delete_snapshot" :: held 1.531s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:30 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Created reservations ['b8b58788-5999-470c-94f7-e61d82046a4d', '42e0ba5a-1a1b-4c00-88e8-7256cf6254c8', '0947e83a-ad8e-4e96-980f-e1ef971a1832', '943608e8-859a-49ab-b0e3-511335ed2237'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:30 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Delete snapshot completed successfully.
Nov 03 08:18:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-506dad7f-9d67-48f7-bc17-6b31b0995cb9 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-9a25c2fb-300f-428a-ba76-956cbecbb47e-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "cinder-f6d59a6f-6808-4804-92c6-d4f1db25bea5-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-f6d59a6f-6808-4804-92c6-d4f1db25bea5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "cinder-quobyte-f6d59a6f-6808-4804-92c6-d4f1db25bea5" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-f6d59a6f-6808-4804-92c6-d4f1db25bea5" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc2aa7a-b51d-4374-bf55-2f53f239662b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:30 devstack sudo[105498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5
Nov 03 08:18:30 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:31 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5" returned: 0 in 0.350s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:31 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5
Nov 03 08:18:31 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:31 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f6d59a6f-6808-4804-92c6-d4f1db25bea5" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-f6d59a6f-6808-4804-92c6-d4f1db25bea5" released by "delete_volume" :: held 0.662s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Created reservations ['7bef223b-9a97-4cd3-a1a7-2b5bc2ba718b', '1c13b083-dcf9-4051-a7b9-3b57df759b6b', '11128fbd-7795-4a52-81a2-3d4c6d2072e9', '5e4f83c7-1e41-46b7-8ef7-81db1cc2a034'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:31 devstack sudo[105506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:18:31 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:31 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.237s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:31 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Deleted volume successfully.
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a8ddeb7f-9896-4d65-8f13-2e1601b74fb5 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-f6d59a6f-6808-4804-92c6-d4f1db25bea5-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "cinder-0158a850-133e-4eb7-8387-9e6bb0363aa8-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-0158a850-133e-4eb7-8387-9e6bb0363aa8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "cinder-quobyte-0158a850-133e-4eb7-8387-9e6bb0363aa8" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-0158a850-133e-4eb7-8387-9e6bb0363aa8" acquired by "delete_volume" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fcfde7-c119-4633-9c77-d11fc54d2fe3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:31 devstack sudo[105509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8
Nov 03 08:18:31 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:32 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8" returned: 0 in 0.360s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:32 devstack sudo[105516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8
Nov 03 08:18:32 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:32 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0158a850-133e-4eb7-8387-9e6bb0363aa8" returned: 0 in 0.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-quobyte-0158a850-133e-4eb7-8387-9e6bb0363aa8" released by "delete_volume" :: held 0.664s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Created reservations ['5719b99e-cd2e-4396-8d89-0af8d0397725', '4ca34d65-634b-447e-ac8b-4c46b61198db', '11781236-9b14-4aa9-86b2-5260f297574c', '28d80007-4d18-479f-828e-214d1558cf76'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:32 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:18:32 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:32 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.240s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:18:32 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Deleted volume successfully.
Nov 03 08:18:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff3e6f1d-46b8-48ba-b962-7d497edaf4c7 tempest-SnapshotDependencyTests-1494913754 None] Lock "cinder-0158a850-133e-4eb7-8387-9e6bb0363aa8-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:18:42 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:18:42 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Flow 'volume_create_manager' (df378d9f-a23a-47e4-96b4-deed4e1c72c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4fda51-dc13-4862-97cc-982274881e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4fda51-dc13-4862-97cc-982274881e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-531383780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d2dfbf-4c2d-4c63-a8a3-58bb3d800775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe19004da668452a9b1425a05701833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:53Z,use_quota=True,user_id='a7408e1130c64dadad5f05fde5219379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ab3d0f-9804-4ab6-ba35-99bfb2e91eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ab3d0f-9804-4ab6-ba35-99bfb2e91eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2facd5-c0b3-4482-b577-8e9620cfb78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2facd5-c0b3-4482-b577-8e9620cfb78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d2dfbf-4c2d-4c63-a8a3-58bb3d800775', 'volume_name': 'volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a438d8c-2e53-4c90-ab77-93ab973cd287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a438d8c-2e53-4c90-ab77-93ab973cd287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59801762-2781-4f6b-8629-a3a04c053da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:52 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Volume 88d2dfbf-4c2d-4c63-a8a3-58bb3d800775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775', 'volume_size': 1}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-531383780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d2dfbf-4c2d-4c63-a8a3-58bb3d800775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe19004da668452a9b1425a05701833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:53Z,use_quota=True,user_id='a7408e1130c64dadad5f05fde5219379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Creating volume 88d2dfbf-4c2d-4c63-a8a3-58bb3d800775 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:52 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:52 devstack sudo[105602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775 1073741824
Nov 03 08:18:52 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (64f8d46b-e727-4a68-a579-0479de61dafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b435f773-459a-4913-9876-687d52c58536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Flow 'volume_create_manager' (a5900f64-fb47-4ca8-a740-2c07c0872154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd80800d-3dee-48ef-8419-c9ed000cfe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b435f773-459a-4913-9876-687d52c58536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550662113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f145061f-1e21-49fc-a235-ad61d68ea29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:53Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339e2701-9f67-49ed-9990-0d14176c2773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339e2701-9f67-49ed-9990-0d14176c2773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2166fed-69bc-4b64-afd0-6659f8cf8c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2166fed-69bc-4b64-afd0-6659f8cf8c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f145061f-1e21-49fc-a235-ad61d68ea29c', 'volume_name': 'volume-f145061f-1e21-49fc-a235-ad61d68ea29c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9aa0b4-1f5d-4f99-8f60-cea451f629a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9aa0b4-1f5d-4f99-8f60-cea451f629a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552cf22d-3f6d-4e79-8706-080662807e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume f145061f-1e21-49fc-a235-ad61d68ea29c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f145061f-1e21-49fc-a235-ad61d68ea29c', 'volume_size': 1}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd80800d-3dee-48ef-8419-c9ed000cfe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-749518279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e6d14b-1864-4b89-8eaf-9427746e96ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe19004da668452a9b1425a05701833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:53Z,use_quota=True,user_id='a7408e1130c64dadad5f05fde5219379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebbfbc6-5f47-4fe6-8d55-b75b3cbe2908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebbfbc6-5f47-4fe6-8d55-b75b3cbe2908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0727370-36f9-4271-a56d-cf79781c2988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0727370-36f9-4271-a56d-cf79781c2988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e6d14b-1864-4b89-8eaf-9427746e96ab', 'volume_name': 'volume-91e6d14b-1864-4b89-8eaf-9427746e96ab', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9817d8-7dee-426a-8d0b-f7f5714c32d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9817d8-7dee-426a-8d0b-f7f5714c32d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf307ab2-82d4-43e0-88bc-f50c98731547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Volume 91e6d14b-1864-4b89-8eaf-9427746e96ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e6d14b-1864-4b89-8eaf-9427746e96ab', 'volume_size': 1}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (dfefa1ef-a167-423b-b923-8b59129de222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59ae062-8992-4a4b-adf6-ccf41f4fde3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59ae062-8992-4a4b-adf6-ccf41f4fde3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530602417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caffb1bc-84e7-4cdb-afc9-168d6215daa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:53Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea7bd51-2b05-4b7d-a4ad-898216d0247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea7bd51-2b05-4b7d-a4ad-898216d0247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b79dfe-301a-446a-99fb-9b070046899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b79dfe-301a-446a-99fb-9b070046899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caffb1bc-84e7-4cdb-afc9-168d6215daa5', 'volume_name': 'volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c61d1b2-d49d-4c7d-bd2c-47d30ceeae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c61d1b2-d49d-4c7d-bd2c-47d30ceeae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cf0745-0b82-4ae9-9cfa-25085a7dc1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume caffb1bc-84e7-4cdb-afc9-168d6215daa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5', 'volume_size': 1}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Flow 'volume_create_manager' (8bdc31e9-1787-4cc2-899a-7dbf21eae65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9e501c-8185-4d84-951d-c0b2edeade3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9e501c-8185-4d84-951d-c0b2edeade3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1447451754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e85cc89-abd7-40c5-89d4-d4d77eb8c276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe19004da668452a9b1425a05701833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:53Z,use_quota=True,user_id='a7408e1130c64dadad5f05fde5219379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23972234-0514-4fda-8451-fce17a883905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23972234-0514-4fda-8451-fce17a883905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36597f2-fb24-43d6-aa75-544e751b59e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36597f2-fb24-43d6-aa75-544e751b59e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e85cc89-abd7-40c5-89d4-d4d77eb8c276', 'volume_name': 'volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105d5893-717a-4ce2-b9ec-f91ab64ff694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105d5893-717a-4ce2-b9ec-f91ab64ff694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b194d905-001b-4d15-801f-9a6a27420ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Volume 6e85cc89-abd7-40c5-89d4-d4d77eb8c276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276', 'volume_size': 1}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775 1073741824" returned: 0 in 0.852s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:53 devstack sudo[105609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775
Nov 03 08:18:53 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Flow 'volume_create_manager' (63af17cc-1f73-486f-ac6c-1a4c2d50fc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c54e417-1d37-4c0f-a9e4-756ba434090e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c54e417-1d37-4c0f-a9e4-756ba434090e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070223134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18f29ee-c920-4595-b175-2d380a7ae75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe19004da668452a9b1425a05701833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:54Z,use_quota=True,user_id='a7408e1130c64dadad5f05fde5219379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e05b4dc-6509-4c3d-8194-1e429c37231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e05b4dc-6509-4c3d-8194-1e429c37231f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802c7d0d-80a3-4a4e-a346-6cccbe93fa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802c7d0d-80a3-4a4e-a346-6cccbe93fa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18f29ee-c920-4595-b175-2d380a7ae75a', 'volume_name': 'volume-b18f29ee-c920-4595-b175-2d380a7ae75a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befa61b4-2b7e-4006-bfdb-85041a5dd00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befa61b4-2b7e-4006-bfdb-85041a5dd00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1753106f-3fb9-44b5-ba82-90c8a9b22c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:54 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Volume b18f29ee-c920-4595-b175-2d380a7ae75a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18f29ee-c920-4595-b175-2d380a7ae75a', 'volume_size': 1}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:54 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775" returned: 0 in 0.293s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550662113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f145061f-1e21-49fc-a235-ad61d68ea29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:53Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Creating volume f145061f-1e21-49fc-a235-ad61d68ea29c {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:54 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59801762-2781-4f6b-8629-a3a04c053da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde27704-0f27-49c9-8f0d-5da955059fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:54 devstack sudo[105613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c 1073741824
Nov 03 08:18:54 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:54 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Volume volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775 (88d2dfbf-4c2d-4c63-a8a3-58bb3d800775): created successfully
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde27704-0f27-49c9-8f0d-5da955059fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Flow 'volume_create_manager' (df378d9f-a23a-47e4-96b4-deed4e1c72c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:54 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-08575e0b-24ee-4d3e-91fe-3a139474c244 tempest-CreateVolumesFromImageTest-500451093 None] Created volume successfully.
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Flow 'volume_create_manager' (6f44d61f-8714-4a19-8105-3c5ede6c8805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e2b6f2-824a-478f-8f75-6a1bc586d4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e2b6f2-824a-478f-8f75-6a1bc586d4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1236986537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af497d6b-1b72-4f35-89de-56839aec6b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe19004da668452a9b1425a05701833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:54Z,use_quota=True,user_id='a7408e1130c64dadad5f05fde5219379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5bd8e5-cd6a-411c-89cd-07aaac8c304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5bd8e5-cd6a-411c-89cd-07aaac8c304a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84b6b25-5fc3-402b-b557-1991da29d50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84b6b25-5fc3-402b-b557-1991da29d50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af497d6b-1b72-4f35-89de-56839aec6b0d', 'volume_name': 'volume-af497d6b-1b72-4f35-89de-56839aec6b0d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdb2c3d-85cc-4da2-8314-b2f93576c75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdb2c3d-85cc-4da2-8314-b2f93576c75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304cab8e-c5bf-41ee-8ebc-b493de618824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:54 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Volume af497d6b-1b72-4f35-89de-56839aec6b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af497d6b-1b72-4f35-89de-56839aec6b0d', 'volume_size': 1}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:54 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c 1073741824" returned: 0 in 0.581s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:54 devstack sudo[105619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c
Nov 03 08:18:54 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:54 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c" returned: 0 in 0.250s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.619s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-749518279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e6d14b-1864-4b89-8eaf-9427746e96ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe19004da668452a9b1425a05701833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:53Z,use_quota=True,user_id='a7408e1130c64dadad5f05fde5219379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Creating volume 91e6d14b-1864-4b89-8eaf-9427746e96ab {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:54 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552cf22d-3f6d-4e79-8706-080662807e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f145061f-1e21-49fc-a235-ad61d68ea29c', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:55 devstack sudo[105622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab 1073741824
Nov 03 08:18:55 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8797d8-9628-4646-b8a5-c39b5c367132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:55 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume volume-f145061f-1e21-49fc-a235-ad61d68ea29c (f145061f-1e21-49fc-a235-ad61d68ea29c): created successfully
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8797d8-9628-4646-b8a5-c39b5c367132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (64f8d46b-e727-4a68-a579-0479de61dafe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5dc72fde-66a0-4e23-80ba-a2a26c01014b tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created volume successfully.
Nov 03 08:18:55 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab 1073741824" returned: 0 in 0.476s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:55 devstack sudo[105628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab
Nov 03 08:18:55 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:55 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab" returned: 0 in 0.248s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530602417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caffb1bc-84e7-4cdb-afc9-168d6215daa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:53Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Creating volume caffb1bc-84e7-4cdb-afc9-168d6215daa5 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:55 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:55 devstack sudo[105631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 1073741824
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf307ab2-82d4-43e0-88bc-f50c98731547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e6d14b-1864-4b89-8eaf-9427746e96ab', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:55 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f963ce4d-6ab8-4bd0-900b-542b36d135f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:55 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Volume volume-91e6d14b-1864-4b89-8eaf-9427746e96ab (91e6d14b-1864-4b89-8eaf-9427746e96ab): created successfully
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f963ce4d-6ab8-4bd0-900b-542b36d135f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Flow 'volume_create_manager' (a5900f64-fb47-4ca8-a740-2c07c0872154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8f2c95a3-73ba-4feb-b4a5-a289df7d5ace tempest-CreateVolumesFromImageTest-500451093 None] Created volume successfully.
Nov 03 08:18:56 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 1073741824" returned: 0 in 0.508s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:56 devstack sudo[105637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5
Nov 03 08:18:56 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (c28d4571-53ab-45ef-81fa-2844d0290c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8649ee3f-f8b6-46cb-bdfa-8aa79d6bb335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8649ee3f-f8b6-46cb-bdfa-8aa79d6bb335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-157454442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c841c0-6018-4256-bdd8-a32a572a69bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:56Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97e6167-fdac-4041-b562-1361c0f217b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97e6167-fdac-4041-b562-1361c0f217b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53633fd0-4184-4cc4-a6bf-bc0d6b8c7192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53633fd0-4184-4cc4-a6bf-bc0d6b8c7192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c841c0-6018-4256-bdd8-a32a572a69bf', 'volume_name': 'volume-86c841c0-6018-4256-bdd8-a32a572a69bf', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ffedb7-aff7-4d57-9abb-d07b74b21bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ffedb7-aff7-4d57-9abb-d07b74b21bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77cb8c7d-fc44-4e06-8a16-5ac7f085572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:56 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume 86c841c0-6018-4256-bdd8-a32a572a69bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c841c0-6018-4256-bdd8-a32a572a69bf', 'volume_size': 1}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:56 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5" returned: 0 in 0.301s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.860s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1447451754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e85cc89-abd7-40c5-89d4-d4d77eb8c276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe19004da668452a9b1425a05701833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:53Z,use_quota=True,user_id='a7408e1130c64dadad5f05fde5219379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Creating volume 6e85cc89-abd7-40c5-89d4-d4d77eb8c276 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:56 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cf0745-0b82-4ae9-9cfa-25085a7dc1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8387d81-491b-4b9d-b545-296b22c0dceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:56 devstack sudo[105640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276 1073741824
Nov 03 08:18:56 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:56 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 (caffb1bc-84e7-4cdb-afc9-168d6215daa5): created successfully
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8387d81-491b-4b9d-b545-296b22c0dceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:56 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (dfefa1ef-a167-423b-b923-8b59129de222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:56 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d7fa54d7-e296-4fd4-9b57-3875a8b5d4ce tempest-CreateVolumesFromSnapshotTest-620643780 None] Created volume successfully.
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (b47960a4-a3ab-4b2a-a40b-2e0facf8bb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7426a52-ac4f-49ab-aca1-9ea1e65c6e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7426a52-ac4f-49ab-aca1-9ea1e65c6e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864572632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d053c3b-3451-4ad5-8811-aa939a431461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:57Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5753fb5b-a32f-4d0f-8e87-c86c283d2d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5753fb5b-a32f-4d0f-8e87-c86c283d2d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9403e87d-71bf-4d25-b604-f60c4379fd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9403e87d-71bf-4d25-b604-f60c4379fd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d053c3b-3451-4ad5-8811-aa939a431461', 'volume_name': 'volume-3d053c3b-3451-4ad5-8811-aa939a431461', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37f9093-e1c1-49b7-bda7-2491b463bc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37f9093-e1c1-49b7-bda7-2491b463bc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d978c84-2c2a-447e-92e7-3f6e954e7cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume 3d053c3b-3451-4ad5-8811-aa939a431461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d053c3b-3451-4ad5-8811-aa939a431461', 'volume_size': 1}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:57 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276 1073741824" returned: 0 in 0.637s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:57 devstack sudo[105646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276
Nov 03 08:18:57 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Flow 'volume_create_manager' (4863f22a-f775-494d-9a39-59a69c8f72eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa416bcc-e5dd-464c-992b-ff90cc9e684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa416bcc-e5dd-464c-992b-ff90cc9e684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e94543-cc28-44fb-94bc-d480a35c4c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249c2975f4764500997b56fd5fa24e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:57Z,use_quota=True,user_id='b8f41ab8d86c4165867810dc37224679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(867d6066-0e2a-4cf7-b6ac-50c0b3fe4e71),volume_type_id=867d6066-0e2a-4cf7-b6ac-50c0b3fe4e71)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c89ef05-069a-4774-b7c7-a457937081ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c89ef05-069a-4774-b7c7-a457937081ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35763df3-9c77-4a35-bea6-841de243901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.image.glance [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Creating Keystone auth plugin from conf {{(pid=86851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (924740ec-7e60-4ba9-b4d9-16304e9572ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a44f9b-76e6-4e02-b25a-074de473662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a44f9b-76e6-4e02-b25a-074de473662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491475657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:58Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811eb220-a30e-4b44-81de-e47558956dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811eb220-a30e-4b44-81de-e47558956dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfefca2-8a6a-4237-9963-c2e4fd304b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfefca2-8a6a-4237-9963-c2e4fd304b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04', 'volume_name': 'volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5425f16c-a556-4901-a6fa-ee74cb1b5934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5425f16c-a556-4901-a6fa-ee74cb1b5934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c28ffd-31ba-405e-bc0b-9d22db13172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04', 'volume_size': 1}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276" returned: 0 in 0.374s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.645s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070223134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18f29ee-c920-4595-b175-2d380a7ae75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe19004da668452a9b1425a05701833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:54Z,use_quota=True,user_id='a7408e1130c64dadad5f05fde5219379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Creating volume b18f29ee-c920-4595-b175-2d380a7ae75a {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:57 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:57 devstack sudo[105649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a 1073741824
Nov 03 08:18:57 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b194d905-001b-4d15-801f-9a6a27420ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c715a423-df2a-44d8-b803-deaf16754bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Volume volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276 (6e85cc89-abd7-40c5-89d4-d4d77eb8c276): created successfully
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c715a423-df2a-44d8-b803-deaf16754bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Flow 'volume_create_manager' (8bdc31e9-1787-4cc2-899a-7dbf21eae65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ec80eaa4-f7d6-4385-b6d7-cda31efb1284 tempest-CreateVolumesFromImageTest-500451093 None] Created volume successfully.
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35763df3-9c77-4a35-bea6-841de243901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9e94543-cc28-44fb-94bc-d480a35c4c22', 'volume_name': 'volume-b9e94543-cc28-44fb-94bc-d480a35c4c22', 'volume_size': 1, 'image_id': '53446b49-bb4b-4151-9092-03501d179078', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53446b49-bb4b-4151-9092-03501d179078', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd61a1aef770bf32f2d431b02fe891ac8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '249c2975f4764500997b56fd5fa24e1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2238bf6cf5b7dcf5b9c930583006c83c6cc96eb8e4362e8ed6499a177d018917b103fafa65da11eeaed6d28c56f279f788db1908077b78389dd6b0d604dff5e5', 'id': '53446b49-bb4b-4151-9092-03501d179078', 'created_at': datetime.datetime(2026, 11, 3, 7, 18, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 18, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53446b49-bb4b-4151-9092-03501d179078/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f768e90>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bf2343-5cd7-43dd-88b1-34edf9fdcde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bf2343-5cd7-43dd-88b1-34edf9fdcde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b64ab37-e015-4712-8003-013a89df31fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:57 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Volume b9e94543-cc28-44fb-94bc-d480a35c4c22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9e94543-cc28-44fb-94bc-d480a35c4c22', 'volume_size': 1, 'image_id': '53446b49-bb4b-4151-9092-03501d179078', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53446b49-bb4b-4151-9092-03501d179078', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd61a1aef770bf32f2d431b02fe891ac8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '249c2975f4764500997b56fd5fa24e1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2238bf6cf5b7dcf5b9c930583006c83c6cc96eb8e4362e8ed6499a177d018917b103fafa65da11eeaed6d28c56f279f788db1908077b78389dd6b0d604dff5e5', 'id': '53446b49-bb4b-4151-9092-03501d179078', 'created_at': datetime.datetime(2026, 11, 3, 7, 18, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 18, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53446b49-bb4b-4151-9092-03501d179078/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f768e90>}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Trying to clone b9e94543-cc28-44fb-94bc-d480a35c4c22 from image 53446b49-bb4b-4151-9092-03501d179078 at location (None, [{'url': 'file:///opt/stack/data/glance/images/53446b49-bb4b-4151-9092-03501d179078', 'metadata': {}}]). {{(pid=86851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 08:18:57 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (a0c6d98e-4c13-4431-8db8-df605d7ccf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e6d36f-a375-4e8a-ad8c-e0ff8f6ed32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 08:18:58 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e6d36f-a375-4e8a-ad8c-e0ff8f6ed32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-336685617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc239ed-d4c6-48ed-a38a-894c0c2d9e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:58Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da7ee12-d269-4a2d-bb83-84a146be9e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da7ee12-d269-4a2d-bb83-84a146be9e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b68884-9db9-42be-aa37-581824ffdcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b68884-9db9-42be-aa37-581824ffdcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc239ed-d4c6-48ed-a38a-894c0c2d9e49', 'volume_name': 'volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff86ca8f-5996-44ed-b425-f4b042d9a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff86ca8f-5996-44ed-b425-f4b042d9a059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fe0b91-657d-494d-8bd4-25338817e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume 3cc239ed-d4c6-48ed-a38a-894c0c2d9e49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49', 'volume_size': 1}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c243c621-03fe-43a6-a9ae-974d69eff9bc]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:58 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD
Nov 03 08:18:58 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:58 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a 1073741824" returned: 0 in 0.596s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:58 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a
Nov 03 08:18:58 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (52e86eb2-b3fb-4ab8-bb33-5a636fbdfb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d90026-3f66-425e-83ad-0ec5896059f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d90026-3f66-425e-83ad-0ec5896059f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1431179357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2a4ba7-fa78-4e0c-9759-e655153e9d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:58Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:58 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af6c8de-3cdd-4748-9cb0-10d5f290a912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af6c8de-3cdd-4748-9cb0-10d5f290a912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ecc2690-271a-42a0-9dab-d6f2291c70e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ecc2690-271a-42a0-9dab-d6f2291c70e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2a4ba7-fa78-4e0c-9759-e655153e9d42', 'volume_name': 'volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c8ed81-b553-48cd-a9df-2e0a2f15cc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c8ed81-b553-48cd-a9df-2e0a2f15cc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622ca17d-fbae-4c16-a370-a9e35c838411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume ec2a4ba7-fa78-4e0c-9759-e655153e9d42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42', 'volume_size': 1}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:58 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a" returned: 0 in 0.303s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.083s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1236986537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af497d6b-1b72-4f35-89de-56839aec6b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe19004da668452a9b1425a05701833c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:54Z,use_quota=True,user_id='a7408e1130c64dadad5f05fde5219379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Creating volume af497d6b-1b72-4f35-89de-56839aec6b0d {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:58 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:58 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d 1073741824
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1753106f-3fb9-44b5-ba82-90c8a9b22c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18f29ee-c920-4595-b175-2d380a7ae75a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:58 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c09e29-5416-4b9e-9cbc-c4111cf38421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:58 devstack sudo[105661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD
Nov 03 08:18:58 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:58 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Volume volume-b18f29ee-c920-4595-b175-2d380a7ae75a (b18f29ee-c920-4595-b175-2d380a7ae75a): created successfully
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c09e29-5416-4b9e-9cbc-c4111cf38421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Flow 'volume_create_manager' (63af17cc-1f73-486f-ac6c-1a4c2d50fc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f6e23170-4387-4d5d-8b1e-11808830a9a9 tempest-CreateVolumesFromImageTest-500451093 None] Created volume successfully.
Nov 03 08:18:58 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:18:58 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Temporary image 53446b49-bb4b-4151-9092-03501d179078 is fetched for user b8f41ab8d86c4165867810dc37224679. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d372308-c421-4633-b705-527b55afa592]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:59 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d 1073741824" returned: 0 in 0.443s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:59 devstack sudo[105673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD
Nov 03 08:18:59 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:59 devstack sudo[105675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d
Nov 03 08:18:59 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:59 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:59 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d" returned: 0 in 0.263s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.835s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-157454442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c841c0-6018-4256-bdd8-a32a572a69bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:56Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Creating volume 86c841c0-6018-4256-bdd8-a32a572a69bf {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:18:59 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:59 devstack sudo[105681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf 1073741824
Nov 03 08:18:59 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304cab8e-c5bf-41ee-8ebc-b493de618824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af497d6b-1b72-4f35-89de-56839aec6b0d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ba5c42-8a34-4f13-be2a-ab2e43612b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:18:59 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD
Nov 03 08:18:59 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:59 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Volume volume-af497d6b-1b72-4f35-89de-56839aec6b0d (af497d6b-1b72-4f35-89de-56839aec6b0d): created successfully
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ba5c42-8a34-4f13-be2a-ab2e43612b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Flow 'volume_create_manager' (6f44d61f-8714-4a19-8105-3c5ede6c8805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:18:59 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4445ec56-e3bb-4cb3-8cc2-43fc0d2d2390 tempest-CreateVolumesFromImageTest-500451093 None] Created volume successfully.
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "cinder-af497d6b-1b72-4f35-89de-56839aec6b0d-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-af497d6b-1b72-4f35-89de-56839aec6b0d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "cinder-quobyte-af497d6b-1b72-4f35-89de-56839aec6b0d" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:18:59 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-quobyte-af497d6b-1b72-4f35-89de-56839aec6b0d" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7824216a-abec-4077-ba3f-bcb700be2ddb]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:59 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d
Nov 03 08:18:59 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:18:59 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf 1073741824" returned: 0 in 0.474s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:18:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:18:59 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf
Nov 03 08:18:59 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:00 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d" returned: 0 in 0.384s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:00 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d
Nov 03 08:19:00 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:00 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf" returned: 0 in 0.262s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.036s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864572632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d053c3b-3451-4ad5-8811-aa939a431461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:57Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Creating volume 3d053c3b-3451-4ad5-8811-aa939a431461 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:00 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77cb8c7d-fc44-4e06-8a16-5ac7f085572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c841c0-6018-4256-bdd8-a32a572a69bf', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:00 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461 1073741824
Nov 03 08:19:00 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c03286-6f75-4fcb-b2e1-ed50a2c3fd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:00 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume volume-86c841c0-6018-4256-bdd8-a32a572a69bf (86c841c0-6018-4256-bdd8-a32a572a69bf): created successfully
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c03286-6f75-4fcb-b2e1-ed50a2c3fd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (c28d4571-53ab-45ef-81fa-2844d0290c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:00 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0b165d05-6079-4ac7-9812-a8f437707c1c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created volume successfully.
Nov 03 08:19:00 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-af497d6b-1b72-4f35-89de-56839aec6b0d" returned: 0 in 0.252s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-quobyte-af497d6b-1b72-4f35-89de-56839aec6b0d" released by "delete_volume" :: held 0.683s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Created reservations ['66d33a9c-d31c-4cfb-86fd-1c24665ae56b', '35cfb5ca-d27c-44a9-bdbb-3968dd26d7f6', '92c46f28-e9ce-4885-b67c-2b3937130f15', 'c12e5e94-0d67-4eac-9785-8116db4ecfc4'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:00 devstack sudo[105706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:00 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:00 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461 1073741824" returned: 0 in 0.495s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:00 devstack sudo[105709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461
Nov 03 08:19:00 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "cinder-b18f29ee-c920-4595-b175-2d380a7ae75a-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:00 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:00 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Deleted volume successfully.
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-b18f29ee-c920-4595-b175-2d380a7ae75a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6b058da9-8add-42ff-a8d7-63574aa01059 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-af497d6b-1b72-4f35-89de-56839aec6b0d-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "cinder-quobyte-b18f29ee-c920-4595-b175-2d380a7ae75a" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-quobyte-b18f29ee-c920-4595-b175-2d380a7ae75a" acquired by "delete_volume" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d410b92e-179a-4bf4-92ab-4e2cda24e836]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:01 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461" returned: 0 in 0.262s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.630s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d978c84-2c2a-447e-92e7-3f6e954e7cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d053c3b-3451-4ad5-8811-aa939a431461', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b2591e-e959-4663-932b-7655abdf1898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Creating offline snapshot 199b7e9d-0da0-4699-a0f8-2e9deccd3a64 of volume caffb1bc-84e7-4cdb-afc9-168d6215daa5 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:19:01 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a
Nov 03 08:19:01 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:01 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume volume-3d053c3b-3451-4ad5-8811-aa939a431461 (3d053c3b-3451-4ad5-8811-aa939a431461): created successfully
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b2591e-e959-4663-932b-7655abdf1898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (b47960a4-a3ab-4b2a-a40b-2e0facf8bb19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3998a38e-1304-4db6-bf70-469b1d30566a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7e1bef5c-b5ee-425f-9306-295d022365ba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created volume successfully.
Nov 03 08:19:01 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5
Nov 03 08:19:01 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:01 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a" returned: 0 in 0.375s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:01 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a
Nov 03 08:19:01 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:01 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5" returned: 0 in 0.389s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:01 devstack sudo[105725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64 1G
Nov 03 08:19:01 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:01 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b18f29ee-c920-4595-b175-2d380a7ae75a" returned: 0 in 0.272s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-quobyte-b18f29ee-c920-4595-b175-2d380a7ae75a" released by "delete_volume" :: held 0.699s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Created reservations ['56f12331-80ca-41da-8001-f3878cc33c6c', 'f079c2a1-bb91-42c7-b039-18217b9ae21f', '7adaf1f8-8064-4a59-84e5-3b8309249c30', '43a67386-cf3c-4a1b-bcdb-90e68a8e68ea'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:01 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:01 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:01 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64 1G" returned: 0 in 0.422s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:01 devstack sudo[105733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64
Nov 03 08:19:01 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:02 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "cinder-6e85cc89-abd7-40c5-89d4-d4d77eb8c276-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.276s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Deleted volume successfully.
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-6e85cc89-abd7-40c5-89d4-d4d77eb8c276-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d4bce7b1-6991-4c3f-bcbc-08a7b609bd0f tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-b18f29ee-c920-4595-b175-2d380a7ae75a-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "cinder-quobyte-6e85cc89-abd7-40c5-89d4-d4d77eb8c276" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-quobyte-6e85cc89-abd7-40c5-89d4-d4d77eb8c276" acquired by "delete_volume" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[830bae88-a9f4-4c66-bc1a-0d90d8eb687a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:02 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64" returned: 0 in 0.337s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:02 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64 is being set with open permissions: ugo+rw
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:02 devstack sudo[105740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64
Nov 03 08:19:02 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:02 devstack sudo[105738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276
Nov 03 08:19:02 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:02 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64" returned: 0 in 0.262s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:02 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276" returned: 0 in 0.406s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:02 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.info
Nov 03 08:19:02 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:02 devstack sudo[105748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276
Nov 03 08:19:02 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:02 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.info" returned: 0 in 0.259s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:02 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.info is being set with open permissions: ugo+rw
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:02 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6e85cc89-abd7-40c5-89d4-d4d77eb8c276" returned: 0 in 0.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:02 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.info
Nov 03 08:19:02 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-quobyte-6e85cc89-abd7-40c5-89d4-d4d77eb8c276" released by "delete_volume" :: held 0.728s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Created reservations ['e2a16872-6df8-4774-a125-3dea484c5946', 'f5ea886f-f0cf-4855-9ac0-ed46d27d2cd8', '7342506f-e078-4a4a-ad9e-006a6d97499b', '315aa02e-f6db-4318-bd78-921f61beae0d'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:02 devstack sudo[105755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:02 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:03 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.info" returned: 0 in 0.253s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.404s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491475657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:58Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Creating volume c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:03 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:03 devstack sudo[105758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04 1073741824
Nov 03 08:19:03 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:03 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-169c854f-908c-48ae-9579-1db5b6d05dfe tempest-CreateVolumesFromSnapshotTest-620643780 None] Create snapshot completed successfully
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "cinder-91e6d14b-1864-4b89-8eaf-9427746e96ab-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:03 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.295s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:03 devstack sudo[105761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:03 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-91e6d14b-1864-4b89-8eaf-9427746e96ab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:03 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Deleted volume successfully.
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5cf38a93-12f0-45ba-b5ac-9f6f2ae48fa9 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-6e85cc89-abd7-40c5-89d4-d4d77eb8c276-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "cinder-quobyte-91e6d14b-1864-4b89-8eaf-9427746e96ab" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-quobyte-91e6d14b-1864-4b89-8eaf-9427746e96ab" acquired by "delete_volume" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09ffffe-c1bc-40e8-b802-b0de451f0077]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:03 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab
Nov 03 08:19:03 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:03 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.315s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:19:03 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04 1073741824" returned: 0 in 0.558s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:03 devstack sudo[105770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04
Nov 03 08:19:03 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:03 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab" returned: 0 in 0.449s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:03 devstack sudo[105775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab
Nov 03 08:19:03 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:03 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04" returned: 0 in 0.293s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.916s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-336685617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc239ed-d4c6-48ed-a38a-894c0c2d9e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:58Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Creating volume 3cc239ed-d4c6-48ed-a38a-894c0c2d9e49 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:04 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c28ffd-31ba-405e-bc0b-9d22db13172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:04 devstack sudo[105778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49 1073741824
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0e19e3-31ab-42a8-8803-3e46ea43e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:04 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:04 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04 (c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04): created successfully
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0e19e3-31ab-42a8-8803-3e46ea43e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (924740ec-7e60-4ba9-b4d9-16304e9572ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:04 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2a7d40c0-222b-443e-a310-372511460a7e tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created volume successfully.
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (dc57f0a0-39c1-42a9-9fd0-0bc7e26c3b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de193951-39b1-48c4-936b-be847d91278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de193951-39b1-48c4-936b-be847d91278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-830124566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5684e570-c6c8-4259-87a9-648f9f4ba421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:04Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4d5a1f-8416-42c0-ae8f-0e413b390a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4d5a1f-8416-42c0-ae8f-0e413b390a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7add19d4-4cc1-4ce0-8b03-b4979f538d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:04 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7add19d4-4cc1-4ce0-8b03-b4979f538d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5684e570-c6c8-4259-87a9-648f9f4ba421', 'volume_name': 'volume-5684e570-c6c8-4259-87a9-648f9f4ba421', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926a3dcf-53ef-4a86-b95e-ba3570a8d9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926a3dcf-53ef-4a86-b95e-ba3570a8d9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc87535-098d-487b-bdce-c0fc56277039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:04 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume 5684e570-c6c8-4259-87a9-648f9f4ba421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5684e570-c6c8-4259-87a9-648f9f4ba421', 'volume_size': 1}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-91e6d14b-1864-4b89-8eaf-9427746e96ab" returned: 0 in 0.388s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-quobyte-91e6d14b-1864-4b89-8eaf-9427746e96ab" released by "delete_volume" :: held 0.881s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Created reservations ['a5468b91-3daa-4d07-ac10-695184f7af10', '3bf51b62-a044-4214-bf2a-4dfde9c9cee6', '3967b4a5-d85a-45d0-a257-b86b636a6dcf', '58cd5df8-543a-4c8f-a5c5-c816b599870c'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:04 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:04 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "cinder-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "cinder-quobyte-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-quobyte-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75b2415-1dcb-486d-9b2d-d5ba3896c7b9]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:04 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49 1073741824" returned: 0 in 0.693s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:04 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.355s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:04 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Deleted volume successfully.
Nov 03 08:19:04 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49
Nov 03 08:19:04 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7eb431c2-a099-4501-8361-2b0291ce1e82 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-91e6d14b-1864-4b89-8eaf-9427746e96ab-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:04 devstack sudo[105788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775
Nov 03 08:19:04 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (1bddaecf-45ec-41d5-8301-758a1f674961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7676aa53-01fa-442c-9a9b-354aa273ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7676aa53-01fa-442c-9a9b-354aa273ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349860539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d73175d-ce62-412c-835f-299d76621d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:05Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0832f12-f9b0-4098-afb7-3acf78cf62f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0832f12-f9b0-4098-afb7-3acf78cf62f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e326ef5-6172-461c-b912-4e6593bfa13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e326ef5-6172-461c-b912-4e6593bfa13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d73175d-ce62-412c-835f-299d76621d89', 'volume_name': 'volume-7d73175d-ce62-412c-835f-299d76621d89', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831684b9-4b12-4877-ade0-41634decaa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831684b9-4b12-4877-ade0-41634decaa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7670f752-0d16-4151-8ce0-df9e2fe640f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume 7d73175d-ce62-412c-835f-299d76621d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d73175d-ce62-412c-835f-299d76621d89', 'volume_size': 1}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49" returned: 0 in 0.304s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.451s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1431179357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2a4ba7-fa78-4e0c-9759-e655153e9d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b90debe4e42dd8a88a428bdb9c9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:58Z,use_quota=True,user_id='4c21e8930f094683a564c320eaaa5845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Creating volume ec2a4ba7-fa78-4e0c-9759-e655153e9d42 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:05 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fe0b91-657d-494d-8bd4-25338817e829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f20074-908a-48e4-ae5f-7ed33102caba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack sudo[105794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42 1073741824
Nov 03 08:19:05 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49 (3cc239ed-d4c6-48ed-a38a-894c0c2d9e49): created successfully
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f20074-908a-48e4-ae5f-7ed33102caba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (a0c6d98e-4c13-4431-8db8-df605d7ccf79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:05 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f3f303f8-6f42-403b-878e-061b37dc5961 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created volume successfully.
Nov 03 08:19:05 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775" returned: 0 in 0.618s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:05 devstack sudo[105799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775
Nov 03 08:19:05 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (4a9bed44-ed7e-475a-91fa-c5167e8599e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aaa21ea-029b-4fc5-872a-bd47be34fc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aaa21ea-029b-4fc5-872a-bd47be34fc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203024613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a89f07-fa75-441b-a74c-f9a81f462cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:05Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841e859e-ec23-4763-b3ae-8e221bcb9bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841e859e-ec23-4763-b3ae-8e221bcb9bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0877010-67c5-41b4-b717-6f95b6a04b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0877010-67c5-41b4-b717-6f95b6a04b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a89f07-fa75-441b-a74c-f9a81f462cbd', 'volume_name': 'volume-86a89f07-fa75-441b-a74c-f9a81f462cbd', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398a6618-d9e8-4f81-9620-2193067acd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398a6618-d9e8-4f81-9620-2193067acd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf9f5c2-ca8c-4359-ad7a-a9c39e947be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume 86a89f07-fa75-441b-a74c-f9a81f462cbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a89f07-fa75-441b-a74c-f9a81f462cbd', 'volume_size': 1}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:05 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775" returned: 0 in 0.342s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-quobyte-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775" released by "delete_volume" :: held 1.019s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:05 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42 1073741824" returned: 0 in 0.577s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Created reservations ['3030b57a-29fd-4ecf-9bd6-f95dabc3a7f1', '97c70f23-7d68-47d4-9711-c8b8070a5060', 'c9e95199-1a9b-4738-b3a2-667d01b2edae', '6f658031-dc49-465e-9a2a-d4129b7c6470'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:05 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42
Nov 03 08:19:05 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (b9900648-96df-40e4-9be9-43fb3901c2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97d5430-6943-48dd-872b-a043ef0f3f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97d5430-6943-48dd-872b-a043ef0f3f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-562891074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d614e5-7125-47c0-8638-3410193d1788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:06Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf19e946-a0f7-4758-853b-daa8076d2cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf19e946-a0f7-4758-853b-daa8076d2cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a472223c-3081-4d45-b5e7-d877a6eb0ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a472223c-3081-4d45-b5e7-d877a6eb0ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d614e5-7125-47c0-8638-3410193d1788', 'volume_name': 'volume-15d614e5-7125-47c0-8638-3410193d1788', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b0836c-aa7b-412c-8a0f-ec9d5732eb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b0836c-aa7b-412c-8a0f-ec9d5732eb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448a49ca-3cea-476d-9857-7fba16952ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume 15d614e5-7125-47c0-8638-3410193d1788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d614e5-7125-47c0-8638-3410193d1788', 'volume_size': 1}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:05 devstack sudo[105808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:05 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:05 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42" returned: 0 in 0.307s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.278s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e94543-cc28-44fb-94bc-d480a35c4c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249c2975f4764500997b56fd5fa24e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:57Z,use_quota=True,user_id='b8f41ab8d86c4165867810dc37224679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(867d6066-0e2a-4cf7-b6ac-50c0b3fe4e71),volume_type_id=867d6066-0e2a-4cf7-b6ac-50c0b3fe4e71)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Creating volume b9e94543-cc28-44fb-94bc-d480a35c4c22 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:06 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622ca17d-fbae-4c16-a370-a9e35c838411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a7e960-3b57-4fc7-96f8-3bdd6d0a0ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:06 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Volume volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42 (ec2a4ba7-fa78-4e0c-9759-e655153e9d42): created successfully
Nov 03 08:19:06 devstack sudo[105811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 1073741824
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a7e960-3b57-4fc7-96f8-3bdd6d0a0ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:06 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Flow 'volume_create_manager' (52e86eb2-b3fb-4ab8-bb33-5a636fbdfb84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-edc4a460-e951-413a-b96d-20245858e5d8 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created volume successfully.
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (3111375f-5a26-4cf5-9d11-5f2d9cdb9493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ea3d04-cc8e-43d3-ab75-bab1df97ce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ea3d04-cc8e-43d3-ab75-bab1df97ce76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141455190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b949a00f-32b4-409c-993b-c6c5c0eda69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:06Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d52f40-56ba-47c4-845f-368e23e093f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d52f40-56ba-47c4-845f-368e23e093f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:06 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bdbc0d-ca97-4351-9a2a-ad547c748497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bdbc0d-ca97-4351-9a2a-ad547c748497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b949a00f-32b4-409c-993b-c6c5c0eda69b', 'volume_name': 'volume-b949a00f-32b4-409c-993b-c6c5c0eda69b', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29f9478-2eeb-4bf1-9711-ce282e54beac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29f9478-2eeb-4bf1-9711-ce282e54beac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba8b176-375a-465e-93e8-2c573b9bd018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:06 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume b949a00f-32b4-409c-993b-c6c5c0eda69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b949a00f-32b4-409c-993b-c6c5c0eda69b', 'volume_size': 1}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.391s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Deleted volume successfully.
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-796ad8a8-afca-4202-8b89-3203f03cf8e2 tempest-CreateVolumesFromImageTest-500451093 None] Lock "cinder-88d2dfbf-4c2d-4c63-a8a3-58bb3d800775-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-ec2a4ba7-fa78-4e0c-9759-e655153e9d42-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-ec2a4ba7-fa78-4e0c-9759-e655153e9d42-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-quobyte-ec2a4ba7-fa78-4e0c-9759-e655153e9d42" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-ec2a4ba7-fa78-4e0c-9759-e655153e9d42" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f22825-a52e-470c-8bbc-0627ab7b853b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:06 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42
Nov 03 08:19:06 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:06 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 1073741824" returned: 0 in 0.540s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:06 devstack sudo[105820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22
Nov 03 08:19:06 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:06 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42" returned: 0 in 0.394s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:06 devstack sudo[105826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42
Nov 03 08:19:06 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:06 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22" returned: 0 in 0.256s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.635s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-830124566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5684e570-c6c8-4259-87a9-648f9f4ba421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:04Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Creating volume 5684e570-c6c8-4259-87a9-648f9f4ba421 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:06 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:06 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421 1073741824
Nov 03 08:19:06 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Attempting download of 53446b49-bb4b-4151-9092-03501d179078 ((None, [{'url': 'file:///opt/stack/data/glance/images/53446b49-bb4b-4151-9092-03501d179078', 'metadata': {}}])) to volume b9e94543-cc28-44fb-94bc-d480a35c4c22. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8489964c-954c-4a73-adcc-6ea201ac71da]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53446b49-bb4b-4151-9092-03501d179078_wm_hp0xx {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:07 devstack sudo[105830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53446b49-bb4b-4151-9092-03501d179078_wm_hp0xx
Nov 03 08:19:07 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:07 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ec2a4ba7-fa78-4e0c-9759-e655153e9d42" returned: 0 in 0.337s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-ec2a4ba7-fa78-4e0c-9759-e655153e9d42" released by "delete_volume" :: held 0.781s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created reservations ['55425c8c-3d44-4ade-8a69-df4186bc3ec8', '6adba268-c6e5-475e-bb3c-c90543704b2e', 'cb3a208c-a761-4877-a149-f5a10fcf57b7', 'ba8c5c65-c5a3-4f2b-a4f5-56d6d0036f02'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:07 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53446b49-bb4b-4151-9092-03501d179078_wm_hp0xx" returned: 0 in 0.409s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53446b49-bb4b-4151-9092-03501d179078_wm_hp0xx {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:07 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:07 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:07 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421 1073741824" returned: 0 in 0.599s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:07 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53446b49-bb4b-4151-9092-03501d179078_wm_hp0xx
Nov 03 08:19:07 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:07 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421
Nov 03 08:19:07 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-quobyte-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd9747b-ff68-49e8-9ecd-edf27849ef5c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:07 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49
Nov 03 08:19:07 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:07 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.506s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:07 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53446b49-bb4b-4151-9092-03501d179078_wm_hp0xx" returned: 1 in 0.497s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53446b49-bb4b-4151-9092-03501d179078_wm_hp0xx' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[709f82c0-3631-40c5-95cb-701480ea70ef]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:07 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Deleted volume successfully.
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e53bf5a5-dda9-440f-9d82-901ecf862a68 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-ec2a4ba7-fa78-4e0c-9759-e655153e9d42-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:07 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421" returned: 0 in 0.465s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.937s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349860539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d73175d-ce62-412c-835f-299d76621d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:05Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Creating volume 7d73175d-ce62-412c-835f-299d76621d89 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:08 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:08 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD
Nov 03 08:19:08 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc87535-098d-487b-bdce-c0fc56277039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5684e570-c6c8-4259-87a9-648f9f4ba421', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:08 devstack sudo[105852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89 1073741824
Nov 03 08:19:08 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2afbcb-e467-491c-8b3f-d5405272fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:08 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume volume-5684e570-c6c8-4259-87a9-648f9f4ba421 (5684e570-c6c8-4259-87a9-648f9f4ba421): created successfully
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2afbcb-e467-491c-8b3f-d5405272fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (dc57f0a0-39c1-42a9-9fd0-0bc7e26c3b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:08 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-dc03ceed-2059-4455-87b8-1517158781cf tempest-CreateVolumesFromSnapshotTest-620643780 None] Created volume successfully.
Nov 03 08:19:08 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49" returned: 0 in 0.627s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:08 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:08 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49
Nov 03 08:19:08 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:08 devstack sudo[105862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD
Nov 03 08:19:08 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:08 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49" returned: 0 in 0.350s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49" released by "delete_volume" :: held 1.042s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:08 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89 1073741824" returned: 0 in 0.720s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:08 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD" returned: 1 in 0.455s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] 53446b49-bb4b-4151-9092-03501d179078 was raw, converting to qcow2 {{(pid=86851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:08 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89
Nov 03 08:19:08 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created reservations ['0184f143-d14c-4a32-96c4-36b5d5f476f7', '9b04f52f-694e-4e06-a0b1-15182825c1a2', '0a9e4aaf-c482-45af-85e0-a5c88df59174', 'c215000e-df77-4dc4-a8f3-d7b3e51ef2e1'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:08 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22
Nov 03 08:19:08 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:08 devstack sudo[105877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:08 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:09 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89" returned: 0 in 0.344s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.646s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203024613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a89f07-fa75-441b-a74c-f9a81f462cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:05Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Creating volume 86a89f07-fa75-441b-a74c-f9a81f462cbd {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:09 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7670f752-0d16-4151-8ce0-df9e2fe640f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d73175d-ce62-412c-835f-299d76621d89', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:09 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd 1073741824
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d18780-ecbb-4d0c-8476-ff119746532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:09 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:09 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume volume-7d73175d-ce62-412c-835f-299d76621d89 (7d73175d-ce62-412c-835f-299d76621d89): created successfully
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d18780-ecbb-4d0c-8476-ff119746532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (1bddaecf-45ec-41d5-8301-758a1f674961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-3c4c8994-3607-4aaf-831e-5f7841abb617 tempest-CreateVolumesFromSnapshotTest-620643780 None] Created volume successfully.
Nov 03 08:19:09 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.395s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Deleted volume successfully.
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6ce266e8-916f-48e9-abc7-28afd802d639 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-3cc239ed-d4c6-48ed-a38a-894c0c2d9e49-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:09 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22" returned: 0 in 0.698s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_53446b49-bb4b-4151-9092-03501d179078_sxnk_0m0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:19:09 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:09 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 1G
Nov 03 08:19:09 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:09 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd 1073741824" returned: 0 in 0.624s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:09 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd
Nov 03 08:19:09 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:09 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 1G" returned: 0 in 0.454s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Downloaded image 53446b49-bb4b-4151-9092-03501d179078 ((None, [{'url': 'file:///opt/stack/data/glance/images/53446b49-bb4b-4151-9092-03501d179078', 'metadata': {}}])) to volume b9e94543-cc28-44fb-94bc-d480a35c4c22 successfully. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Temporary image 53446b49-bb4b-4151-9092-03501d179078 for user b8f41ab8d86c4165867810dc37224679 is deleted. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Marking volume b9e94543-cc28-44fb-94bc-d480a35c4c22 as bootable. {{(pid=86851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Copying metadata from image 53446b49-bb4b-4151-9092-03501d179078 to b9e94543-cc28-44fb-94bc-d480a35c4c22. {{(pid=86851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 08:19:09 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Creating volume glance metadata for volume b9e94543-cc28-44fb-94bc-d480a35c4c22 backed by image 53446b49-bb4b-4151-9092-03501d179078 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '53446b49-bb4b-4151-9092-03501d179078', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd61a1aef770bf32f2d431b02fe891ac8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-quobyte-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9005fa5c-a46d-46b1-9115-e9fadd9d30b1]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:10 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd" returned: 0 in 0.292s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.257s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-562891074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d614e5-7125-47c0-8638-3410193d1788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:06Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Creating volume 15d614e5-7125-47c0-8638-3410193d1788 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:10 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf9f5c2-ca8c-4359-ad7a-a9c39e947be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a89f07-fa75-441b-a74c-f9a81f462cbd', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:10 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788 1073741824
Nov 03 08:19:10 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae9a62c-a8cf-46a2-a23d-a89f206b4b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b64ab37-e015-4712-8003-013a89df31fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e94543-cc28-44fb-94bc-d480a35c4c22', 'volume_size': 1, 'image_id': '53446b49-bb4b-4151-9092-03501d179078', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53446b49-bb4b-4151-9092-03501d179078', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd61a1aef770bf32f2d431b02fe891ac8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '249c2975f4764500997b56fd5fa24e1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2238bf6cf5b7dcf5b9c930583006c83c6cc96eb8e4362e8ed6499a177d018917b103fafa65da11eeaed6d28c56f279f788db1908077b78389dd6b0d604dff5e5', 'id': '53446b49-bb4b-4151-9092-03501d179078', 'created_at': datetime.datetime(2026, 11, 3, 7, 18, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 18, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53446b49-bb4b-4151-9092-03501d179078/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d466f768e90>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83631cd8-38bc-45bd-8178-dbc36343e69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:10 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume volume-86a89f07-fa75-441b-a74c-f9a81f462cbd (86a89f07-fa75-441b-a74c-f9a81f462cbd): created successfully
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae9a62c-a8cf-46a2-a23d-a89f206b4b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (4a9bed44-ed7e-475a-91fa-c5167e8599e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:10 devstack sudo[105899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04
Nov 03 08:19:10 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:10 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Volume volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 (b9e94543-cc28-44fb-94bc-d480a35c4c22): created successfully
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83631cd8-38bc-45bd-8178-dbc36343e69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Flow 'volume_create_manager' (4863f22a-f775-494d-9a39-59a69c8f72eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4e1da040-9130-4324-9591-56f95d068c02 tempest-CreateVolumesFromSnapshotTest-620643780 None] Created volume successfully.
Nov 03 08:19:10 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7f710b5b-bd8a-426d-918c-90b5b5092ee6 tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Created volume successfully.
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Acquiring lock "cinder-b9e94543-cc28-44fb-94bc-d480a35c4c22-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Lock "cinder-b9e94543-cc28-44fb-94bc-d480a35c4c22-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:10 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04" returned: 0 in 0.490s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:10 devstack sudo[105909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04
Nov 03 08:19:10 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Acquiring lock "cinder-quobyte-b9e94543-cc28-44fb-94bc-d480a35c4c22" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Lock "cinder-quobyte-b9e94543-cc28-44fb-94bc-d480a35c4c22" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5976e818-ceb9-411d-977e-d352ac266e74]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:10 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788 1073741824" returned: 0 in 0.623s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:10 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22
Nov 03 08:19:10 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:10 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788
Nov 03 08:19:10 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:10 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04" returned: 0 in 0.322s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04" released by "delete_volume" :: held 0.890s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:10 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created reservations ['79f6ef63-7068-4cd7-9dd9-26642ede04e1', 'e3590ef9-c538-4a66-986e-b68bebdcb33b', 'e6384cee-821b-43ca-af23-6335241d795c', 'e0acda42-1360-4911-be18-ddb62b144f49'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:11 devstack sudo[105920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:11 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:11 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22" returned: 0 in 0.431s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-3d053c3b-3451-4ad5-8811-aa939a431461-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:11 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788" returned: 0 in 0.372s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.885s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141455190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b949a00f-32b4-409c-993b-c6c5c0eda69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2c84db8a6c4f77b26ee6dc048b53c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:06Z,use_quota=True,user_id='b18d1201ecfb4ab78e291a53bb7b8388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Creating volume b949a00f-32b4-409c-993b-c6c5c0eda69b {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:11 devstack sudo[105923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22
Nov 03 08:19:11 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:11 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448a49ca-3cea-476d-9857-7fba16952ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d614e5-7125-47c0-8638-3410193d1788', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6e536f-4d69-4eea-9a86-8c47df8b604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:11 devstack sudo[105925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b 1073741824
Nov 03 08:19:11 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-3d053c3b-3451-4ad5-8811-aa939a431461-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:11 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume volume-15d614e5-7125-47c0-8638-3410193d1788 (15d614e5-7125-47c0-8638-3410193d1788): created successfully
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6e536f-4d69-4eea-9a86-8c47df8b604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (b9900648-96df-40e4-9be9-43fb3901c2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-81e556a0-3b85-4084-bd0e-3dd82040283b tempest-CreateVolumesFromSnapshotTest-620643780 None] Created volume successfully.
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-quobyte-3d053c3b-3451-4ad5-8811-aa939a431461" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-3d053c3b-3451-4ad5-8811-aa939a431461" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[089cb077-2161-49c8-bda2-454bd645bdbd]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:11 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.404s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Deleted volume successfully.
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8b452260-0d7e-4192-9f94-e76c1c01dc18 tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-c9dd8739-dee2-4ba6-95c2-dff1dbd4ac04-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:11 devstack sudo[105928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461
Nov 03 08:19:11 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:11 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b9e94543-cc28-44fb-94bc-d480a35c4c22" returned: 0 in 0.413s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Lock "cinder-quobyte-b9e94543-cc28-44fb-94bc-d480a35c4c22" released by "delete_volume" :: held 0.906s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Created reservations ['36f8100e-a1a5-4f2d-9042-7bd7dd1fd954', '442a0baa-544f-408b-b7df-f275afb79902', '10a9e229-8aa3-4268-87a4-147a4bf5832d', 'a07e95f5-bab8-4168-b297-a49bc7bc2499'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:11 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:11 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:11 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b 1073741824" returned: 0 in 0.641s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:11 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461" returned: 0 in 0.464s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:11 devstack sudo[105940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461
Nov 03 08:19:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:11 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:11 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b
Nov 03 08:19:11 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:12 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.318s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Deleted volume successfully.
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e95e4514-aca8-479e-91d1-0bc76cbcd53d tempest-VolumeAndVolumeTypeFromImageTest-1535275960 None] Lock "cinder-b9e94543-cc28-44fb-94bc-d480a35c4c22-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:12 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3d053c3b-3451-4ad5-8811-aa939a431461" returned: 0 in 0.293s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:12 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b" returned: 0 in 0.282s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-3d053c3b-3451-4ad5-8811-aa939a431461" released by "delete_volume" :: held 0.837s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba8b176-375a-465e-93e8-2c573b9bd018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b949a00f-32b4-409c-993b-c6c5c0eda69b', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3659eb59-7747-4b60-8da9-4857b40eac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:12 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Volume volume-b949a00f-32b4-409c-993b-c6c5c0eda69b (b949a00f-32b4-409c-993b-c6c5c0eda69b): created successfully
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3659eb59-7747-4b60-8da9-4857b40eac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Flow 'volume_create_manager' (3111375f-5a26-4cf5-9d11-5f2d9cdb9493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ccf89c1f-ea79-438d-b3dc-44ee5289ce66 tempest-CreateVolumesFromSnapshotTest-620643780 None] Created volume successfully.
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created reservations ['f3a4ee41-8ce6-4d30-a691-e93477b0fe3f', '8b442292-3947-422f-a568-8331c0b6b939', '3b69e6a2-de1b-4578-994a-9c3e317fb7bb', '143bbcf7-1b6a-49b8-9436-898a79a0e1df'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:12 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:12 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:12 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.251s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Deleted volume successfully.
Nov 03 08:19:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93647e99-d8ad-4708-a876-92117cc1979c tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-3d053c3b-3451-4ad5-8811-aa939a431461-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-b949a00f-32b4-409c-993b-c6c5c0eda69b-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-b949a00f-32b4-409c-993b-c6c5c0eda69b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-quobyte-b949a00f-32b4-409c-993b-c6c5c0eda69b" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-b949a00f-32b4-409c-993b-c6c5c0eda69b" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68747e5-3a66-47fd-9ff7-3d0dc414dcf7]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:13 devstack sudo[105950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b
Nov 03 08:19:13 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-86c841c0-6018-4256-bdd8-a32a572a69bf-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-86c841c0-6018-4256-bdd8-a32a572a69bf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-quobyte-86c841c0-6018-4256-bdd8-a32a572a69bf" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-86c841c0-6018-4256-bdd8-a32a572a69bf" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3458946d-f6ef-440b-b820-9da863340db4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:13 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b" returned: 0 in 0.533s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:13 devstack sudo[105956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b
Nov 03 08:19:13 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:13 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf
Nov 03 08:19:13 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:13 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b949a00f-32b4-409c-993b-c6c5c0eda69b" returned: 0 in 0.277s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-b949a00f-32b4-409c-993b-c6c5c0eda69b" released by "delete_volume" :: held 0.871s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Created reservations ['a2718933-57c6-43fc-b40b-b586b1512cf1', '5deda348-7752-47d0-b653-730016d515e4', '62b81997-0c70-46ac-bd99-5a275b3c8524', '3c161636-15de-4170-94a7-1e5de7ebc264'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf" returned: 0 in 0.451s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:14 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:14 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf
Nov 03 08:19:14 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:14 devstack sudo[105966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:14 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-15d614e5-7125-47c0-8638-3410193d1788-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-15d614e5-7125-47c0-8638-3410193d1788-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-quobyte-15d614e5-7125-47c0-8638-3410193d1788" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-15d614e5-7125-47c0-8638-3410193d1788" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:14 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86c841c0-6018-4256-bdd8-a32a572a69bf" returned: 0 in 0.401s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-86c841c0-6018-4256-bdd8-a32a572a69bf" released by "delete_volume" :: held 0.913s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bda531a-1073-4cdd-8f3a-a700ffdab63b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:14 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.315s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:14 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Deleted volume successfully.
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created reservations ['467708f8-74d0-485f-be7e-1987b72c5f8d', '62ef4b58-4e67-4897-aa5e-74e6330998ba', '560b7a00-140a-45d7-8fbe-4a522e5612ed', '59e41c0f-522c-468d-bbd3-24fdb9b57151'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a37c29d7-ef4f-478b-a7c7-add84d567c01 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-b949a00f-32b4-409c-993b-c6c5c0eda69b-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:14 devstack sudo[105970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788
Nov 03 08:19:14 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:14 devstack sudo[105972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:14 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-f145061f-1e21-49fc-a235-ad61d68ea29c-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-f145061f-1e21-49fc-a235-ad61d68ea29c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "cinder-quobyte-f145061f-1e21-49fc-a235-ad61d68ea29c" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-f145061f-1e21-49fc-a235-ad61d68ea29c" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc2ecdc-28c8-4ba2-aa0e-845ea7990231]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:15 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788" returned: 0 in 0.478s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:15 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788
Nov 03 08:19:15 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:15 devstack sudo[105978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c
Nov 03 08:19:15 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:15 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.416s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:15 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Deleted volume successfully.
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ec12c2cf-c710-4951-b760-47956466ddba tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-86c841c0-6018-4256-bdd8-a32a572a69bf-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:15 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-15d614e5-7125-47c0-8638-3410193d1788" returned: 0 in 0.312s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-15d614e5-7125-47c0-8638-3410193d1788" released by "delete_volume" :: held 0.859s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Created reservations ['b17a5548-74d5-4849-abe7-7e079303c533', '2998b785-48c1-44b6-a3cc-f4dbf5162452', 'f54dac3d-ca02-46c1-95fb-48cb7358ff45', '0ccaf4bf-0f71-4b17-816f-fa19ce962516'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:15 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c" returned: 0 in 0.514s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:15 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c
Nov 03 08:19:15 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:15 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:15 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-86a89f07-fa75-441b-a74c-f9a81f462cbd-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-86a89f07-fa75-441b-a74c-f9a81f462cbd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:15 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-f145061f-1e21-49fc-a235-ad61d68ea29c" returned: 0 in 0.312s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-quobyte-f145061f-1e21-49fc-a235-ad61d68ea29c" released by "delete_volume" :: held 0.884s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-quobyte-86a89f07-fa75-441b-a74c-f9a81f462cbd" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-86a89f07-fa75-441b-a74c-f9a81f462cbd" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[54624469-bb28-4ed9-aae5-be2339730c8e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:15 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.389s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:15 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Deleted volume successfully.
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Created reservations ['ac843ae1-0cdb-4a77-8daf-9c011eb5cc53', 'e34ff946-7575-4430-b3e6-ffa51a30f3d5', '979c51e3-a7c4-4b59-9e6e-a9daa01a8b27', 'f501d9a8-7b00-4874-abf1-bce831b8e6e5'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-0a59700b-84de-4b5c-8ffd-9e5424546440 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-15d614e5-7125-47c0-8638-3410193d1788-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:16 devstack sudo[105994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd
Nov 03 08:19:16 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:16 devstack sudo[105996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:16 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:16 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.294s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:16 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Deleted volume successfully.
Nov 03 08:19:16 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd" returned: 0 in 0.510s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-01990c1b-fddc-4014-b8dc-d5bf384f16fd tempest-CreateVolumesFromSourceVolumeTest-770593170 None] Lock "cinder-f145061f-1e21-49fc-a235-ad61d68ea29c-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:16 devstack sudo[106002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd
Nov 03 08:19:16 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:16 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-86a89f07-fa75-441b-a74c-f9a81f462cbd" returned: 0 in 0.263s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-86a89f07-fa75-441b-a74c-f9a81f462cbd" released by "delete_volume" :: held 0.837s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Created reservations ['31f4a0e6-dc46-478a-97bb-ec08c2f828ea', '4b9783c7-a9e7-4ce5-ab4a-85902d446050', '95454aa9-b5cc-418c-894c-96802ef22211', '99cfc3a7-cc08-45d4-ba15-772e1fdb8e69'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:16 devstack sudo[106005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:16 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-7d73175d-ce62-412c-835f-299d76621d89-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-7d73175d-ce62-412c-835f-299d76621d89-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-quobyte-7d73175d-ce62-412c-835f-299d76621d89" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-7d73175d-ce62-412c-835f-299d76621d89" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[728aa088-586d-4c2f-a00e-129bd51ed745]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:17 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:17 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89
Nov 03 08:19:17 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.386s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Deleted volume successfully.
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ff429a1a-30fd-4bd4-8621-e64f4563769e tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-86a89f07-fa75-441b-a74c-f9a81f462cbd-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:17 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89" returned: 0 in 0.470s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:17 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89
Nov 03 08:19:17 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:17 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7d73175d-ce62-412c-835f-299d76621d89" returned: 0 in 0.296s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-7d73175d-ce62-412c-835f-299d76621d89" released by "delete_volume" :: held 0.858s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:17 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Created reservations ['4caddb0c-5138-4890-8ffb-47dd90f43e0d', 'd4279713-da7e-4512-a426-2150f4d3d802', '9ce8a36b-9e7c-49f1-9af7-5ae529698aae', '6da1e2e0-ccaf-4d4c-b6eb-39d3a09fc008'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:18 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:18 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-5684e570-c6c8-4259-87a9-648f9f4ba421-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-5684e570-c6c8-4259-87a9-648f9f4ba421-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-quobyte-5684e570-c6c8-4259-87a9-648f9f4ba421" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-5684e570-c6c8-4259-87a9-648f9f4ba421" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[249b1e72-6fc2-4a11-910b-2177e21bd7b8]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:18 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.506s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Deleted volume successfully.
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e6c4462a-d385-4e4e-b4a5-7ab78e2feadb tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-7d73175d-ce62-412c-835f-299d76621d89-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:18 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421
Nov 03 08:19:18 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:18 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421" returned: 0 in 0.471s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:18 devstack sudo[106035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421
Nov 03 08:19:18 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:19 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5684e570-c6c8-4259-87a9-648f9f4ba421" returned: 0 in 0.263s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-5684e570-c6c8-4259-87a9-648f9f4ba421" released by "delete_volume" :: held 0.815s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Created reservations ['d0f390d2-4978-4a09-b35d-08a101d57981', 'e8d1e372-bdc3-4684-aad0-99472eefcd60', '5c34b307-3f56-4139-9c55-4d7e4c6d297b', 'c73d83fe-2a94-469f-b8af-5ce4cc335213'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:19 devstack sudo[106038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:19 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-199b7e9d-0da0-4699-a0f8-2e9deccd3a64-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-199b7e9d-0da0-4699-a0f8-2e9deccd3a64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-quobyte-caffb1bc-84e7-4cdb-afc9-168d6215daa5" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-caffb1bc-84e7-4cdb-afc9-168d6215daa5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-quobyte-199b7e9d-0da0-4699-a0f8-2e9deccd3a64" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-199b7e9d-0da0-4699-a0f8-2e9deccd3a64" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Deleting offline snapshot 199b7e9d-0da0-4699-a0f8-2e9deccd3a64 of volume caffb1bc-84e7-4cdb-afc9-168d6215daa5 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] snapshot_file for this snap is: volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0840ac-35c8-46a2-819e-135f70e3433c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:19 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.368s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:19 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64
Nov 03 08:19:19 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:19 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Deleted volume successfully.
Nov 03 08:19:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-525b5ae2-594a-4633-aab2-fe2c2e6439b4 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-5684e570-c6c8-4259-87a9-648f9f4ba421-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:20 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64" returned: 0 in 0.464s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:19:20 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9ded5e-59d2-4191-94d7-342d57df8605]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:20 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5
Nov 03 08:19:20 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:20 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5" returned: 0 in 0.443s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:20 devstack sudo[106052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64
Nov 03 08:19:20 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:20 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64" returned: 0 in 0.388s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:20 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64
Nov 03 08:19:20 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:21 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5.199b7e9d-0da0-4699-a0f8-2e9deccd3a64" returned: 0 in 0.258s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-199b7e9d-0da0-4699-a0f8-2e9deccd3a64" released by "_delete_snapshot" :: held 1.719s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-caffb1bc-84e7-4cdb-afc9-168d6215daa5" released by "delete_snapshot" :: held 1.744s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Created reservations ['3382f918-60b1-4d0d-85ff-cd5252b9bae3', 'bea9943f-1bc5-4748-8ece-1e00ee2ff4e1', '215d6605-04bd-45ff-bde1-ab1f0348d746', '903b28ac-2094-4fb3-8188-332827068f84'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:21 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Delete snapshot completed successfully.
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93c06d55-8aea-4f44-999e-ac65fc62c5ec tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-199b7e9d-0da0-4699-a0f8-2e9deccd3a64-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Flow 'volume_create_manager' (07a87638-c9fe-44bb-821f-f4674de349c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e87e550-32fe-4118-a16c-0600e9144be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e87e550-32fe-4118-a16c-0600e9144be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1367096818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee0f36c-a7d9-47a1-8543-34e074c40f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b37a54be3d1f41ed834e19bd28e9c44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:21Z,use_quota=True,user_id='c23811a188a54c55a43c7ac0ce361395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed6cc50-1512-4030-8df4-44a9598fe774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed6cc50-1512-4030-8df4-44a9598fe774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40da47b3-b3f3-4e74-a1de-c60e1b6e22c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40da47b3-b3f3-4e74-a1de-c60e1b6e22c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee0f36c-a7d9-47a1-8543-34e074c40f12', 'volume_name': 'volume-aee0f36c-a7d9-47a1-8543-34e074c40f12', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce0d7e6-bfec-4931-b1a7-aaa402647f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce0d7e6-bfec-4931-b1a7-aaa402647f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccaaba7-3b69-46bc-ae68-23489b7240c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:21 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Volume aee0f36c-a7d9-47a1-8543-34e074c40f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee0f36c-a7d9-47a1-8543-34e074c40f12', 'volume_size': 1}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1367096818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee0f36c-a7d9-47a1-8543-34e074c40f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b37a54be3d1f41ed834e19bd28e9c44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:21Z,use_quota=True,user_id='c23811a188a54c55a43c7ac0ce361395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Creating volume aee0f36c-a7d9-47a1-8543-34e074c40f12 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:21 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:21 devstack sudo[106060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 1073741824
Nov 03 08:19:21 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-caffb1bc-84e7-4cdb-afc9-168d6215daa5-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-caffb1bc-84e7-4cdb-afc9-168d6215daa5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "cinder-quobyte-caffb1bc-84e7-4cdb-afc9-168d6215daa5" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-caffb1bc-84e7-4cdb-afc9-168d6215daa5" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ce19a4-62e4-4a7a-974d-f0fad1e8e5ee]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:21 devstack sudo[106065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5
Nov 03 08:19:21 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:22 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 1073741824" returned: 0 in 0.563s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:22 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12
Nov 03 08:19:22 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:22 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5" returned: 0 in 0.528s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:22 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5
Nov 03 08:19:22 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:22 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12" returned: 0 in 0.357s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccaaba7-3b69-46bc-ae68-23489b7240c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee0f36c-a7d9-47a1-8543-34e074c40f12', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e48d2f-b460-4a26-a961-142638b183c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:22 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Volume volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 (aee0f36c-a7d9-47a1-8543-34e074c40f12): created successfully
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e48d2f-b460-4a26-a961-142638b183c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Flow 'volume_create_manager' (07a87638-c9fe-44bb-821f-f4674de349c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2fd96d5d-a97f-4078-9312-543df43c7df6 tempest-VolumeDependencyTests-1102294642 None] Created volume successfully.
Nov 03 08:19:22 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-caffb1bc-84e7-4cdb-afc9-168d6215daa5" returned: 0 in 0.350s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-quobyte-caffb1bc-84e7-4cdb-afc9-168d6215daa5" released by "delete_volume" :: held 0.967s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Created reservations ['fdbfae45-f78f-492f-ab8e-206c13213f4b', '1d70a209-c82b-46d6-a0fb-2bf07eb11d38', 'a2bf1248-386c-417f-99d2-4d69d45f47a8', '4e07cd15-aea2-4f1d-a3e4-fd4297b34279'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:22 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:22 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Flow 'volume_create_manager' (3bab5aa6-85fd-4411-b1c8-a03e27d1e145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1ebc78-f6a9-4946-bd7c-7a0f1abc21cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1ebc78-f6a9-4946-bd7c-7a0f1abc21cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fffe5c5-19dc-4d94-ac1f-0474f24553cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c01d8b4ee43c385caebcc154cd10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:23Z,use_quota=True,user_id='630e97c110414f298c9c0c73aaf952e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac81c02b-8c1b-47e0-991e-26e11a4d872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac81c02b-8c1b-47e0-991e-26e11a4d872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b37de2-b204-4e6f-ace5-a5ecbebc9c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:22 devstack cinder-volume[86851]: DEBUG cinder.image.glance [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Creating Keystone auth plugin from conf {{(pid=86851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 08:19:23 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.274s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Deleted volume successfully.
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ab7c5ce3-164f-4a2b-a17b-a014ba9e0fc5 tempest-CreateVolumesFromSnapshotTest-620643780 None] Lock "cinder-caffb1bc-84e7-4cdb-afc9-168d6215daa5-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b37de2-b204-4e6f-ace5-a5ecbebc9c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7fffe5c5-19dc-4d94-ac1f-0474f24553cd', 'volume_name': 'volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd', 'volume_size': 1, 'image_id': '05bc0b5e-0720-42c0-a08e-4107aec62657', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05bc0b5e-0720-42c0-a08e-4107aec62657', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdd1a3d6f31dec1309bd00979fda5b79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b98c01d8b4ee43c385caebcc154cd10a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea31e21022fb061e3fd9dceb52710bcd057e40e7a76fe5ba3342a0135bdfa5a0e89db5fd508dbe7f3bc9da1c9ae85802100ffc9ad015decdbd0fca0801a553c8', 'id': '05bc0b5e-0720-42c0-a08e-4107aec62657', 'created_at': datetime.datetime(2026, 11, 3, 7, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05bc0b5e-0720-42c0-a08e-4107aec62657/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d4665573050>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c65b097-5e30-49f6-bf44-775f83401302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c65b097-5e30-49f6-bf44-775f83401302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90aae7c1-5861-40f8-b9ae-b95dbfeb101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:23 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Volume 7fffe5c5-19dc-4d94-ac1f-0474f24553cd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd', 'volume_size': 1, 'image_id': '05bc0b5e-0720-42c0-a08e-4107aec62657', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05bc0b5e-0720-42c0-a08e-4107aec62657', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdd1a3d6f31dec1309bd00979fda5b79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b98c01d8b4ee43c385caebcc154cd10a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea31e21022fb061e3fd9dceb52710bcd057e40e7a76fe5ba3342a0135bdfa5a0e89db5fd508dbe7f3bc9da1c9ae85802100ffc9ad015decdbd0fca0801a553c8', 'id': '05bc0b5e-0720-42c0-a08e-4107aec62657', 'created_at': datetime.datetime(2026, 11, 3, 7, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05bc0b5e-0720-42c0-a08e-4107aec62657/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d4665573050>}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Trying to clone 7fffe5c5-19dc-4d94-ac1f-0474f24553cd from image 05bc0b5e-0720-42c0-a08e-4107aec62657 at location (None, [{'url': 'file:///opt/stack/data/glance/images/05bc0b5e-0720-42c0-a08e-4107aec62657', 'metadata': {}}]). {{(pid=86851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 08:19:23 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae656a-7d3c-4aed-9490-61486828577c]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:23 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD
Nov 03 08:19:23 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Creating offline snapshot 41458318-78c8-42f1-8c0c-16112dfe49f6 of volume aee0f36c-a7d9-47a1-8543-34e074c40f12 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fbbe10-4617-4ce3-ae26-8b58c1c0d820]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:23 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:23 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12
Nov 03 08:19:23 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:24 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD
Nov 03 08:19:24 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:24 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12" returned: 0 in 0.483s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:24 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Temporary image 05bc0b5e-0720-42c0-a08e-4107aec62657 is fetched for user 630e97c110414f298c9c0c73aaf952e6. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 08:19:24 devstack sudo[106096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 1G
Nov 03 08:19:24 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d8e3c8-2c94-4660-bd66-32f1d7abfd14]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:24 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD
Nov 03 08:19:24 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:24 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:24 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 1G" returned: 0 in 0.598s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:24 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6
Nov 03 08:19:24 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:24 devstack sudo[106106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD
Nov 03 08:19:24 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:25 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD" returned: 1 in 0.439s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:19:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:25 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6" returned: 0 in 0.397s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:25 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 is being set with open permissions: ugo+rw
Nov 03 08:19:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:25 devstack sudo[106117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6
Nov 03 08:19:25 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:25 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6" returned: 0 in 0.281s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:25 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.info
Nov 03 08:19:25 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:25 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.info" returned: 0 in 0.272s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:25 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.info is being set with open permissions: ugo+rw
Nov 03 08:19:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:25 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.info
Nov 03 08:19:25 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:26 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.info" returned: 0 in 0.268s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fffe5c5-19dc-4d94-ac1f-0474f24553cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98c01d8b4ee43c385caebcc154cd10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:23Z,use_quota=True,user_id='630e97c110414f298c9c0c73aaf952e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Creating volume 7fffe5c5-19dc-4d94-ac1f-0474f24553cd {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:26 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:26 devstack sudo[106126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd 1073741824
Nov 03 08:19:26 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:26 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a9f5d9f8-b373-404f-b245-f3dca31a03db tempest-VolumeDependencyTests-1102294642 None] Create snapshot completed successfully
Nov 03 08:19:26 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd 1073741824" returned: 0 in 0.513s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:26 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd
Nov 03 08:19:26 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:27 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd" returned: 0 in 0.332s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Flow 'volume_create_manager' (a41c2044-feb8-450d-bf54-8a0716d77781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13139ee6-9448-42d8-83f1-3da48a86f4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Attempting download of 05bc0b5e-0720-42c0-a08e-4107aec62657 ((None, [{'url': 'file:///opt/stack/data/glance/images/05bc0b5e-0720-42c0-a08e-4107aec62657', 'metadata': {}}])) to volume 7fffe5c5-19dc-4d94-ac1f-0474f24553cd. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13139ee6-9448-42d8-83f1-3da48a86f4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191461627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46459d28ad2646ef9fe0183979be43ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:27Z,use_quota=True,user_id='ccf1ccb60c2b47218f2f4e46a9b7f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7d93ca-6a70-4685-bc39-5891d36bfc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7d93ca-6a70-4685-bc39-5891d36bfc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba7ba1a-9d6f-44e6-a7d9-f9135d508c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba7ba1a-9d6f-44e6-a7d9-f9135d508c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487', 'volume_name': 'volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1609bee-3256-4ca7-a14f-ed47ca2a2263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1609bee-3256-4ca7-a14f-ed47ca2a2263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99d3c5e-c0fa-4b3c-8be2-4dfcedcb7de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:27 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Volume b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487', 'volume_size': 1}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191461627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46459d28ad2646ef9fe0183979be43ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:27Z,use_quota=True,user_id='ccf1ccb60c2b47218f2f4e46a9b7f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Creating volume b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:27 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:27 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487 1073741824
Nov 03 08:19:27 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ce338a-9d18-46ef-ac11-58b3303d6342]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05bc0b5e-0720-42c0-a08e-4107aec62657_zdpo3431 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:27 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05bc0b5e-0720-42c0-a08e-4107aec62657_zdpo3431
Nov 03 08:19:27 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:27 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05bc0b5e-0720-42c0-a08e-4107aec62657_zdpo3431" returned: 0 in 0.440s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05bc0b5e-0720-42c0-a08e-4107aec62657_zdpo3431 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:27 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487 1073741824" returned: 0 in 0.526s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Flow 'volume_create_manager' (f1339523-423a-49d7-9ce9-53f054965d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71aac6a4-ad8e-44b6-ab63-23cf303c5464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71aac6a4-ad8e-44b6-ab63-23cf303c5464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c56611f-60fc-4ea2-81b9-cc1ee1f025bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d277e7d4f014d81a6d913b236588b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:28Z,use_quota=True,user_id='c0685f6d27ee4af3b0f563a174e5c4ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4af404d-05ac-4eb2-b580-db5ddce209c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4af404d-05ac-4eb2-b580-db5ddce209c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:27 devstack sudo[106145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05bc0b5e-0720-42c0-a08e-4107aec62657_zdpo3431
Nov 03 08:19:27 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19c8887-9b8d-49cb-9e07-c57de2f98840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19c8887-9b8d-49cb-9e07-c57de2f98840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c56611f-60fc-4ea2-81b9-cc1ee1f025bd', 'volume_name': 'volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7a6e70-fdd7-47bf-8a11-f95b2de170ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7a6e70-fdd7-47bf-8a11-f95b2de170ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba930200-34f3-40e1-bba2-4509274b14d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:27 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Volume 6c56611f-60fc-4ea2-81b9-cc1ee1f025bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd', 'volume_size': 1}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:27 devstack sudo[106147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487
Nov 03 08:19:27 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:27 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Flow 'volume_create_manager' (244aeecd-ba1d-4396-91bf-1eb5c21c9a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a589041b-0db4-4144-b857-56e49085fd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a589041b-0db4-4144-b857-56e49085fd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1195958309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957d9355-7beb-4351-8b1f-e49eb66db043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b37a54be3d1f41ed834e19bd28e9c44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41458318-78c8-42f1-8c0c-16112dfe49f6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:28Z,use_quota=True,user_id='c23811a188a54c55a43c7ac0ce361395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc13687f-cd79-4b94-b3a8-50a1fd1480c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc13687f-cd79-4b94-b3a8-50a1fd1480c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b32d01e-f48f-49bb-964c-704c3331101c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b32d01e-f48f-49bb-964c-704c3331101c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '957d9355-7beb-4351-8b1f-e49eb66db043', 'volume_name': 'volume-957d9355-7beb-4351-8b1f-e49eb66db043', 'volume_size': 1, 'snapshot_id': '41458318-78c8-42f1-8c0c-16112dfe49f6'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0db29d3-b628-4ac1-8c5b-59d368e9b84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0db29d3-b628-4ac1-8c5b-59d368e9b84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405905a9-401f-450a-ab9c-df584ffc3dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:28 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Volume 957d9355-7beb-4351-8b1f-e49eb66db043: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-957d9355-7beb-4351-8b1f-e49eb66db043', 'volume_size': 1, 'snapshot_id': '41458318-78c8-42f1-8c0c-16112dfe49f6'}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:28 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05bc0b5e-0720-42c0-a08e-4107aec62657_zdpo3431" returned: 1 in 0.332s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05bc0b5e-0720-42c0-a08e-4107aec62657_zdpo3431' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1dfedd-79d0-41f4-98f9-07fca5846f42]: (4, 'raw') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:28 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487" returned: 0 in 0.259s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c56611f-60fc-4ea2-81b9-cc1ee1f025bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d277e7d4f014d81a6d913b236588b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:28Z,use_quota=True,user_id='c0685f6d27ee4af3b0f563a174e5c4ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Creating volume 6c56611f-60fc-4ea2-81b9-cc1ee1f025bd {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:28 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99d3c5e-c0fa-4b3c-8be2-4dfcedcb7de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1580ef-336b-45cb-8369-fe14dd3d4de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:28 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd 1073741824
Nov 03 08:19:28 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:28 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD
Nov 03 08:19:28 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:28 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Volume volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487 (b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487): created successfully
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1580ef-336b-45cb-8369-fe14dd3d4de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Flow 'volume_create_manager' (a41c2044-feb8-450d-bf54-8a0716d77781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:28 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d87ccefd-0b76-429a-834d-1b63881b34d2 tempest-ProjectReaderTests-1620375831 None] Created volume successfully.
Nov 03 08:19:28 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:28 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD
Nov 03 08:19:28 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:28 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd 1073741824" returned: 0 in 0.449s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:28 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd
Nov 03 08:19:28 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:28 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] 05bc0b5e-0720-42c0-a08e-4107aec62657 was raw, converting to qcow2 {{(pid=86851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:28 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd
Nov 03 08:19:28 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:28 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.875s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "cinder-quobyte-41458318-78c8-42f1-8c0c-16112dfe49f6-957d9355-7beb-4351-8b1f-e49eb66db043" by "_create_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba930200-34f3-40e1-bba2-4509274b14d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53a954a-c9ca-47be-821d-454774f1d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-41458318-78c8-42f1-8c0c-16112dfe49f6-957d9355-7beb-4351-8b1f-e49eb66db043" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Creating volume 957d9355-7beb-4351-8b1f-e49eb66db043 from snapshot 41458318-78c8-42f1-8c0c-16112dfe49f6 {{(pid=86851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:28 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "cinder-quobyte-957d9355-7beb-4351-8b1f-e49eb66db043" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-957d9355-7beb-4351-8b1f-e49eb66db043" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] snapshot: 41458318-78c8-42f1-8c0c-16112dfe49f6, volume: 957d9355-7beb-4351-8b1f-e49eb66db043,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:19:29 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Volume volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd (6c56611f-60fc-4ea2-81b9-cc1ee1f025bd): created successfully
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53a954a-c9ca-47be-821d-454774f1d924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Flow 'volume_create_manager' (f1339523-423a-49d7-9ce9-53f054965d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:29 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-52642032-6791-4871-b38c-9aa81776be47 tempest-CinderUnicodeTest-1419813689 None] Created volume successfully.
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb170ae5-4d2f-4f2c-be7d-0541a7a774c1]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:29 devstack sudo[106174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6
Nov 03 08:19:29 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:29 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd" returned: 0 in 0.511s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_05bc0b5e-0720-42c0-a08e-4107aec62657_95pk8ceudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:19:29 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:29 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd 1G
Nov 03 08:19:29 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Acquiring lock "cinder-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Lock "cinder-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Acquiring lock "cinder-quobyte-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Lock "cinder-quobyte-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:29 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6" returned: 0 in 0.430s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aee0f36c-a7d9-47a1-8543-34e074c40f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a16ef4-1acd-4e95-9137-b1e34d4accf0]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce50849-feaf-4224-bc86-96a819ae6f1b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:29 devstack sudo[106184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487
Nov 03 08:19:29 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:29 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12
Nov 03 08:19:29 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:29 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd 1G" returned: 0 in 0.435s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Downloaded image 05bc0b5e-0720-42c0-a08e-4107aec62657 ((None, [{'url': 'file:///opt/stack/data/glance/images/05bc0b5e-0720-42c0-a08e-4107aec62657', 'metadata': {}}])) to volume 7fffe5c5-19dc-4d94-ac1f-0474f24553cd successfully. {{(pid=86851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Temporary image 05bc0b5e-0720-42c0-a08e-4107aec62657 for user 630e97c110414f298c9c0c73aaf952e6 is deleted. {{(pid=86851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.volume_utils [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Marking volume 7fffe5c5-19dc-4d94-ac1f-0474f24553cd as bootable. {{(pid=86851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Copying metadata from image 05bc0b5e-0720-42c0-a08e-4107aec62657 to 7fffe5c5-19dc-4d94-ac1f-0474f24553cd. {{(pid=86851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Creating volume glance metadata for volume 7fffe5c5-19dc-4d94-ac1f-0474f24553cd backed by image 05bc0b5e-0720-42c0-a08e-4107aec62657 with: {'image_id': '05bc0b5e-0720-42c0-a08e-4107aec62657', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cdd1a3d6f31dec1309bd00979fda5b79', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90aae7c1-5861-40f8-b9ae-b95dbfeb101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd', 'volume_size': 1, 'image_id': '05bc0b5e-0720-42c0-a08e-4107aec62657', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05bc0b5e-0720-42c0-a08e-4107aec62657', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdd1a3d6f31dec1309bd00979fda5b79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b98c01d8b4ee43c385caebcc154cd10a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea31e21022fb061e3fd9dceb52710bcd057e40e7a76fe5ba3342a0135bdfa5a0e89db5fd508dbe7f3bc9da1c9ae85802100ffc9ad015decdbd0fca0801a553c8', 'id': '05bc0b5e-0720-42c0-a08e-4107aec62657', 'created_at': datetime.datetime(2026, 11, 3, 7, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05bc0b5e-0720-42c0-a08e-4107aec62657/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d4665573050>}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2670d6-084f-461f-af2a-6690826d986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:29 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Volume volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd (7fffe5c5-19dc-4d94-ac1f-0474f24553cd): created successfully
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2670d6-084f-461f-af2a-6690826d986d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Flow 'volume_create_manager' (3bab5aa6-85fd-4411-b1c8-a03e27d1e145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:29 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-dc510536-5623-4a91-9f8c-f970131b7456 tempest-VolumeImageDependencyTests-2013741677 None] Created volume successfully.
Nov 03 08:19:29 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487" returned: 0 in 0.456s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:30 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12" returned: 0 in 0.474s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:19:30 devstack sudo[106198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487
Nov 03 08:19:30 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043 not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:30 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043
Nov 03 08:19:30 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:30 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487" returned: 0 in 0.328s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Lock "cinder-quobyte-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487" released by "delete_volume" :: held 0.838s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Flow 'volume_create_manager' (70daf804-128a-4d47-8d35-a31ef60749f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d11650-0714-4334-93bd-961d70c21a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d11650-0714-4334-93bd-961d70c21a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1938655615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb906815-cc04-4953-84b8-bccfe4d6d6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d277e7d4f014d81a6d913b236588b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:30Z,use_quota=True,user_id='c0685f6d27ee4af3b0f563a174e5c4ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f64210-9ef0-4f82-b5d5-1a3494b3cdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f64210-9ef0-4f82-b5d5-1a3494b3cdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea057363-e03f-41bf-8e48-6bf064622b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea057363-e03f-41bf-8e48-6bf064622b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb906815-cc04-4953-84b8-bccfe4d6d6e6', 'volume_name': 'volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31961174-3001-45ec-9dbd-da59b3ba9d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31961174-3001-45ec-9dbd-da59b3ba9d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031bbc38-7d02-49c8-999e-36d344ac3b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:30 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Volume eb906815-cc04-4953-84b8-bccfe4d6d6e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6', 'volume_size': 1}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Created reservations ['341a6662-62e0-424f-a400-16371de703c8', 'd10676c4-4e6b-426a-9d1d-ac7ed6f73d58', '5eecd7ce-f379-4d12-8a11-5a99c954a743', '58108f1f-8a65-406a-be39-be35c00b94d5'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:30 devstack sudo[106213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:30 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Acquiring lock "cinder-7fffe5c5-19dc-4d94-ac1f-0474f24553cd-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Lock "cinder-7fffe5c5-19dc-4d94-ac1f-0474f24553cd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Acquiring lock "cinder-quobyte-7fffe5c5-19dc-4d94-ac1f-0474f24553cd" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Lock "cinder-quobyte-7fffe5c5-19dc-4d94-ac1f-0474f24553cd" acquired by "delete_volume" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b39b6dc-7d26-4115-8e1a-b04f5e72b5cb]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:31 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.766s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:31 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Deleted volume successfully.
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-29833df1-31ec-4d4e-ae13-f1faeb2717b8 tempest-ProjectReaderTests-1620375831 None] Lock "cinder-b5b5e4dd-dea8-48cc-a35d-3bfcd2ef5487-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:31 devstack sudo[106216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd
Nov 03 08:19:31 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Flow 'volume_create_manager' (c32331d1-1a66-4227-b226-767ad8cd43cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e888e23f-0f49-4314-8b21-71e7a02859b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e888e23f-0f49-4314-8b21-71e7a02859b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-22847431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4c4db2-62e6-4823-afb8-1bdf5c753123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46459d28ad2646ef9fe0183979be43ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:32Z,use_quota=True,user_id='ccf1ccb60c2b47218f2f4e46a9b7f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d086f9a8-ae65-4097-90e5-5c845d2bedcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d086f9a8-ae65-4097-90e5-5c845d2bedcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3cc5c6-1dd9-487d-996f-efc9258d1780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:31 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3cc5c6-1dd9-487d-996f-efc9258d1780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4c4db2-62e6-4823-afb8-1bdf5c753123', 'volume_name': 'volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d221a9b6-70cd-4152-9aa9-bae6c83dee95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d221a9b6-70cd-4152-9aa9-bae6c83dee95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4970b43f-a3ce-4ed1-8514-821feeb79d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:32 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Volume 3c4c4db2-62e6-4823-afb8-1bdf5c753123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123', 'volume_size': 1}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:32 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd" returned: 0 in 0.688s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:32 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd
Nov 03 08:19:32 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:32 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7fffe5c5-19dc-4d94-ac1f-0474f24553cd" returned: 0 in 0.514s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Lock "cinder-quobyte-7fffe5c5-19dc-4d94-ac1f-0474f24553cd" released by "delete_volume" :: held 1.324s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Created reservations ['6fddec89-5826-4bc3-afd6-b861c319e663', 'c7d194d2-c0d7-4010-a42b-5a42a2692381', 'a6f6e6c0-bcbf-4624-9ff2-6ecb9c200351', '2373eb78-7160-4da4-8cee-4e1c2ed61772'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:32 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:32 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:33 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.374s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:33 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:33 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Deleted volume successfully.
Nov 03 08:19:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-5ade91a0-b1cb-4674-a4e9-57a281290172 tempest-VolumeImageDependencyTests-2013741677 None] Lock "cinder-7fffe5c5-19dc-4d94-ac1f-0474f24553cd-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:37 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043" returned: 0 in 7.546s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:19:37 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Converted 1024.00 MB image at 135.69 MB/s
Nov 03 08:19:37 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043 is being set with open permissions: ugo+rw
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:37 devstack sudo[106230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043
Nov 03 08:19:37 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:37 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043" returned: 0 in 0.245s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-957d9355-7beb-4351-8b1f-e49eb66db043" released by "_copy_volume_from_snapshot" :: held 8.816s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-41458318-78c8-42f1-8c0c-16112dfe49f6-957d9355-7beb-4351-8b1f-e49eb66db043" released by "_create_volume_from_snapshot" :: held 8.885s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.912s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.412s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1938655615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb906815-cc04-4953-84b8-bccfe4d6d6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d277e7d4f014d81a6d913b236588b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:30Z,use_quota=True,user_id='c0685f6d27ee4af3b0f563a174e5c4ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Creating volume eb906815-cc04-4953-84b8-bccfe4d6d6e6 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:37 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:37 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 1073741824
Nov 03 08:19:37 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:37 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405905a9-401f-450a-ab9c-df584ffc3dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957d9355-7beb-4351-8b1f-e49eb66db043', 'volume_size': 1, 'snapshot_id': '41458318-78c8-42f1-8c0c-16112dfe49f6'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f84fbd0-15f4-49d0-bacd-7d0b723be834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:38 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Volume volume-957d9355-7beb-4351-8b1f-e49eb66db043 (957d9355-7beb-4351-8b1f-e49eb66db043): created successfully
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f84fbd0-15f4-49d0-bacd-7d0b723be834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Flow 'volume_create_manager' (244aeecd-ba1d-4396-91bf-1eb5c21c9a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:38 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-caf9e8d3-a256-4337-b1ae-e710500ba1f2 tempest-VolumeDependencyTests-1102294642 None] Created volume successfully.
Nov 03 08:19:38 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 1073741824" returned: 0 in 0.490s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:38 devstack sudo[106275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6
Nov 03 08:19:38 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:38 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6" returned: 0 in 0.244s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.649s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-22847431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4c4db2-62e6-4823-afb8-1bdf5c753123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46459d28ad2646ef9fe0183979be43ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:32Z,use_quota=True,user_id='ccf1ccb60c2b47218f2f4e46a9b7f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Creating volume 3c4c4db2-62e6-4823-afb8-1bdf5c753123 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:38 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031bbc38-7d02-49c8-999e-36d344ac3b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:38 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123 1073741824
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29bc334-46f8-4866-a54a-0b5f971ccc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:38 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:38 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Volume volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 (eb906815-cc04-4953-84b8-bccfe4d6d6e6): created successfully
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29bc334-46f8-4866-a54a-0b5f971ccc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Flow 'volume_create_manager' (70daf804-128a-4d47-8d35-a31ef60749f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-cdb5e6bc-b5af-4697-8792-83b0a1b4e9ed tempest-ProjectAdminTests-1979567053 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7431602478027, 'free_capacity_gb': 1773.7431602478027, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86851) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 08:19:38 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-642f4185-a91c-4422-a99b-1a68e8ce651d tempest-CinderUnicodeTest-1419813689 None] Created volume successfully.
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "cinder-41458318-78c8-42f1-8c0c-16112dfe49f6-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-41458318-78c8-42f1-8c0c-16112dfe49f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "cinder-quobyte-aee0f36c-a7d9-47a1-8543-34e074c40f12" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-aee0f36c-a7d9-47a1-8543-34e074c40f12" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "cinder-quobyte-41458318-78c8-42f1-8c0c-16112dfe49f6" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-41458318-78c8-42f1-8c0c-16112dfe49f6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Deleting offline snapshot 41458318-78c8-42f1-8c0c-16112dfe49f6 of volume aee0f36c-a7d9-47a1-8543-34e074c40f12 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] snapshot_file for this snap is: volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1422bcae-9097-42d8-a501-8a1891fe174c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:38 devstack sudo[106280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6
Nov 03 08:19:38 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:39 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123 1073741824" returned: 0 in 0.562s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:39 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123
Nov 03 08:19:39 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:39 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6" returned: 0 in 0.454s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aee0f36c-a7d9-47a1-8543-34e074c40f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1687b5fd-1ae0-4ea9-aa8b-453cf3f20eb0]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:39 devstack sudo[106290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12
Nov 03 08:19:39 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:39 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123" returned: 0 in 0.297s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4970b43f-a3ce-4ed1-8514-821feeb79d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138f3428-48f5-49f1-ba39-3456b458ad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Creating offline snapshot c0b9e920-ea09-4a16-aeba-8246aff0ddd4 of volume eb906815-cc04-4953-84b8-bccfe4d6d6e6 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:19:39 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Volume volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123 (3c4c4db2-62e6-4823-afb8-1bdf5c753123): created successfully
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138f3428-48f5-49f1-ba39-3456b458ad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Flow 'volume_create_manager' (c32331d1-1a66-4227-b226-767ad8cd43cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:39 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f4ba9f56-e54a-437f-af72-867ee30d73a6 tempest-ProjectReaderTests-1620375831 None] Created volume successfully.
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c79d8-3b5b-4008-b683-849faefc205e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:39 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6
Nov 03 08:19:39 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:39 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12" returned: 0 in 0.595s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:40 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6
Nov 03 08:19:40 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:40 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6" returned: 0 in 0.419s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:40 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4 1G
Nov 03 08:19:40 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:40 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6" returned: 0 in 0.484s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Acquiring lock "cinder-3c4c4db2-62e6-4823-afb8-1bdf5c753123-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:40 devstack sudo[106313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6
Nov 03 08:19:40 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Lock "cinder-3c4c4db2-62e6-4823-afb8-1bdf5c753123-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Acquiring lock "cinder-quobyte-3c4c4db2-62e6-4823-afb8-1bdf5c753123" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Lock "cinder-quobyte-3c4c4db2-62e6-4823-afb8-1bdf5c753123" acquired by "delete_volume" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[736241e4-bbb3-4ce6-9b86-d6091a71296c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:40 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4 1G" returned: 0 in 0.644s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:40 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4
Nov 03 08:19:40 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:40 devstack sudo[106316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123
Nov 03 08:19:40 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:40 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12.41458318-78c8-42f1-8c0c-16112dfe49f6" returned: 0 in 0.404s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-41458318-78c8-42f1-8c0c-16112dfe49f6" released by "_delete_snapshot" :: held 2.086s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-aee0f36c-a7d9-47a1-8543-34e074c40f12" released by "delete_snapshot" :: held 2.109s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:40 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Created reservations ['342c2f67-0c59-4c04-bd05-7d27516be1c2', '30a9b551-4af5-4a55-b07b-96044201ff01', '11da451e-ec37-4565-8e5f-d8023d5ebeaf', '3b1f6cbd-fa84-431c-b617-c97832dc4128'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:41 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123" returned: 0 in 0.439s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:41 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Delete snapshot completed successfully.
Nov 03 08:19:41 devstack sudo[106327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123
Nov 03 08:19:41 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1e3a0bfd-4d52-47aa-82f3-ce9af9dea8ab tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-41458318-78c8-42f1-8c0c-16112dfe49f6-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:41 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4" returned: 0 in 0.419s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:41 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4 is being set with open permissions: ugo+rw
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:41 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4
Nov 03 08:19:41 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:41 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-3c4c4db2-62e6-4823-afb8-1bdf5c753123" returned: 0 in 0.279s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Lock "cinder-quobyte-3c4c4db2-62e6-4823-afb8-1bdf5c753123" released by "delete_volume" :: held 0.771s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:41 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Created reservations ['ead7038b-c6c8-4b6e-8c5b-752fe47efab6', 'a93c628a-b360-455d-8aae-80f9031e82d2', 'c25fc9af-3d0f-4eda-b683-65a719fd22d8', '84baf5ac-3024-47e5-a918-73ee83df1820'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4" returned: 0 in 0.276s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:41 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.info
Nov 03 08:19:41 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:41 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:41 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:41 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.info" returned: 0 in 0.318s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:41 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.info is being set with open permissions: ugo+rw
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:41 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.280s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:41 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Deleted volume successfully.
Nov 03 08:19:41 devstack sudo[106339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.info
Nov 03 08:19:41 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2da13444-3148-4242-b868-8eef5e6d57ef tempest-ProjectReaderTests-1620375831 None] Lock "cinder-3c4c4db2-62e6-4823-afb8-1bdf5c753123-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "cinder-aee0f36c-a7d9-47a1-8543-34e074c40f12-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-aee0f36c-a7d9-47a1-8543-34e074c40f12-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "cinder-quobyte-aee0f36c-a7d9-47a1-8543-34e074c40f12" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-aee0f36c-a7d9-47a1-8543-34e074c40f12" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:42 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.info" returned: 0 in 0.406s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.602s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[987328aa-f7da-4e3c-8e3c-c1bfb75b0ea3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:42 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ead23b7a-826a-4c6c-bdb2-df1c36e6e5cd tempest-CinderUnicodeTest-1419813689 None] Create snapshot completed successfully
Nov 03 08:19:42 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:42 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Flow 'volume_create_manager' (e44031ca-6769-4e6d-b821-c57a7e068124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9682fa02-18c9-4a46-8c65-88c92863abba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9682fa02-18c9-4a46-8c65-88c92863abba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742557232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a644abba-c088-4fbb-8fbd-7ebdd947a0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46459d28ad2646ef9fe0183979be43ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:42Z,use_quota=True,user_id='ccf1ccb60c2b47218f2f4e46a9b7f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbf1037-815a-479f-af0f-127292231072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbf1037-815a-479f-af0f-127292231072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63fe7612-4b5f-4c19-80b0-3f478562e31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63fe7612-4b5f-4c19-80b0-3f478562e31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a644abba-c088-4fbb-8fbd-7ebdd947a0a5', 'volume_name': 'volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830aab41-8943-4409-a25c-863bb1390383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830aab41-8943-4409-a25c-863bb1390383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ba7963-da1c-43c6-8c23-2efd4527743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:42 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Volume a644abba-c088-4fbb-8fbd-7ebdd947a0a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5', 'volume_size': 1}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742557232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a644abba-c088-4fbb-8fbd-7ebdd947a0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46459d28ad2646ef9fe0183979be43ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:42Z,use_quota=True,user_id='ccf1ccb60c2b47218f2f4e46a9b7f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Creating volume a644abba-c088-4fbb-8fbd-7ebdd947a0a5 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:42 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:42 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5 1073741824
Nov 03 08:19:42 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:42 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12" returned: 0 in 0.407s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:42 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12
Nov 03 08:19:42 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "cinder-c0b9e920-ea09-4a16-aeba-8246aff0ddd4-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-c0b9e920-ea09-4a16-aeba-8246aff0ddd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "cinder-quobyte-eb906815-cc04-4953-84b8-bccfe4d6d6e6" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-quobyte-eb906815-cc04-4953-84b8-bccfe4d6d6e6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "cinder-quobyte-c0b9e920-ea09-4a16-aeba-8246aff0ddd4" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-quobyte-c0b9e920-ea09-4a16-aeba-8246aff0ddd4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Deleting offline snapshot c0b9e920-ea09-4a16-aeba-8246aff0ddd4 of volume eb906815-cc04-4953-84b8-bccfe4d6d6e6 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] snapshot_file for this snap is: volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cefa3c5-5dd6-473c-b8b5-90628ab7aad2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:42 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-aee0f36c-a7d9-47a1-8543-34e074c40f12" returned: 0 in 0.342s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:42 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-aee0f36c-a7d9-47a1-8543-34e074c40f12" released by "delete_volume" :: held 0.863s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=267,cinder:SELECT=207,cinder:INSERT=68,cinder:DELETE=19 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Created reservations ['c5fded42-5bbd-42a6-9a16-de7b47d49611', '663a0075-4ebc-4005-a545-d0dede86eabb', '50b83e2e-bf89-4600-9181-561bf242c486', '5e1507f5-8ee1-427e-815c-85e7185de831'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:43 devstack sudo[106356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4
Nov 03 08:19:43 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:43 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5 1073741824" returned: 0 in 0.580s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:43 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5
Nov 03 08:19:43 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:43 devstack sudo[106359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:43 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "cinder-957d9355-7beb-4351-8b1f-e49eb66db043-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-957d9355-7beb-4351-8b1f-e49eb66db043-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "cinder-quobyte-957d9355-7beb-4351-8b1f-e49eb66db043" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:43 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-957d9355-7beb-4351-8b1f-e49eb66db043" acquired by "delete_volume" :: waited 0.033s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.369s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Deleted volume successfully.
Nov 03 08:19:43 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4" returned: 0 in 0.646s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:19:43 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84f3e39-3081-49b5-bc56-a83b1b591695]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fe8a8e-abb5-4cd4-adaf-76fd1f3670ba]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5" returned: 0 in 0.472s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-fb00b36d-d149-41ca-9270-f77b88686805 tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-aee0f36c-a7d9-47a1-8543-34e074c40f12-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ba7963-da1c-43c6-8c23-2efd4527743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81a215b-b50e-4782-bd61-7a9d54e050eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:43 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Volume volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5 (a644abba-c088-4fbb-8fbd-7ebdd947a0a5): created successfully
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81a215b-b50e-4782-bd61-7a9d54e050eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Flow 'volume_create_manager' (e44031ca-6769-4e6d-b821-c57a7e068124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-30ff65ec-fc61-425b-ac59-09a9fb2bb8ea tempest-ProjectReaderTests-1620375831 None] Created volume successfully.
Nov 03 08:19:43 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043
Nov 03 08:19:43 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:43 devstack sudo[106368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6
Nov 03 08:19:43 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:43 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043" returned: 0 in 0.417s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:44 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043
Nov 03 08:19:44 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:44 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6" returned: 0 in 0.470s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:44 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4
Nov 03 08:19:44 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:44 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-957d9355-7beb-4351-8b1f-e49eb66db043" returned: 0 in 0.282s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-quobyte-957d9355-7beb-4351-8b1f-e49eb66db043" released by "delete_volume" :: held 0.781s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Created reservations ['fbadf867-6c0a-47c5-8564-d3cb22746c95', '83e34026-5f26-4747-9b92-48f7f1abdc50', 'e2831d85-acd9-45e9-91da-5e2bdc3f8e35', 'bec64bf7-86bc-4d61-b523-d95c7eee7865'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:44 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:44 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:44 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4" returned: 0 in 0.442s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:44 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4
Nov 03 08:19:44 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Acquiring lock "cinder-a644abba-c088-4fbb-8fbd-7ebdd947a0a5-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Lock "cinder-a644abba-c088-4fbb-8fbd-7ebdd947a0a5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Acquiring lock "cinder-quobyte-a644abba-c088-4fbb-8fbd-7ebdd947a0a5" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Lock "cinder-quobyte-a644abba-c088-4fbb-8fbd-7ebdd947a0a5" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[594a5ba5-c15c-427e-96d6-197576307641]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:44 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.419s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:44 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Deleted volume successfully.
Nov 03 08:19:44 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6.c0b9e920-ea09-4a16-aeba-8246aff0ddd4" returned: 0 in 0.385s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:44 devstack sudo[106392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5
Nov 03 08:19:44 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-93f05027-4d5f-47b7-a7ae-3799bf52e14f tempest-VolumeDependencyTests-1102294642 None] Lock "cinder-957d9355-7beb-4351-8b1f-e49eb66db043-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-quobyte-c0b9e920-ea09-4a16-aeba-8246aff0ddd4" released by "_delete_snapshot" :: held 2.099s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:44 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-quobyte-eb906815-cc04-4953-84b8-bccfe4d6d6e6" released by "delete_snapshot" :: held 2.136s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Created reservations ['bbaaf4b4-cb82-47b2-8012-bdce75bf215d', '47cee915-3132-4891-ac65-f8a1a41de5cb', '39c04e5c-ccf8-4b91-8462-88ba4381f68a', '4129f04b-2f15-4de3-a9fd-d1bacb1d986f'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:45 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Delete snapshot completed successfully.
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-418dd6a7-0b6a-4674-a355-ab9774e959f8 tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-c0b9e920-ea09-4a16-aeba-8246aff0ddd4-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:45 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5" returned: 0 in 0.453s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:45 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5
Nov 03 08:19:45 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:45 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a644abba-c088-4fbb-8fbd-7ebdd947a0a5" returned: 0 in 0.290s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Lock "cinder-quobyte-a644abba-c088-4fbb-8fbd-7ebdd947a0a5" released by "delete_volume" :: held 0.825s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Created reservations ['7652f0a7-6926-432f-b3d7-2f75dfa5f67b', 'a45cf23b-fb88-484f-98da-c8d4dfc85ca9', 'be606d77-f3f0-49bc-bc46-d0f74458f5dd', '09f808cc-ad5c-40ce-a193-70d1d1fd227e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:45 devstack sudo[106401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:45 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:45 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.304s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:45 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:46 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Deleted volume successfully.
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-ad946938-7e9f-452c-921a-20e1a4d0d60d tempest-ProjectReaderTests-1620375831 None] Lock "cinder-a644abba-c088-4fbb-8fbd-7ebdd947a0a5-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "cinder-eb906815-cc04-4953-84b8-bccfe4d6d6e6-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-eb906815-cc04-4953-84b8-bccfe4d6d6e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "cinder-quobyte-eb906815-cc04-4953-84b8-bccfe4d6d6e6" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-quobyte-eb906815-cc04-4953-84b8-bccfe4d6d6e6" acquired by "delete_volume" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[737adcd6-f641-4e8e-940d-97b547398220]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:46 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6
Nov 03 08:19:46 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Flow 'volume_create_manager' (937cef1e-8303-463f-a8f1-9454ef79879d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035ba354-41d5-425e-a610-5bcab2bd2541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035ba354-41d5-425e-a610-5bcab2bd2541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183668559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9e9850-3825-43bf-9c06-90859cb50624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46459d28ad2646ef9fe0183979be43ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:46Z,use_quota=True,user_id='ccf1ccb60c2b47218f2f4e46a9b7f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec2dcdb-dbf7-480b-8092-a8415733b706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec2dcdb-dbf7-480b-8092-a8415733b706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5911aa-538e-4fdb-9b87-869b2043db73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5911aa-538e-4fdb-9b87-869b2043db73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e9e9850-3825-43bf-9c06-90859cb50624', 'volume_name': 'volume-1e9e9850-3825-43bf-9c06-90859cb50624', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47b1b82-aaf1-4dc9-a71d-63d9615ae099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47b1b82-aaf1-4dc9-a71d-63d9615ae099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f71fa6-b523-48cf-9ea9-f1d78a13087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:46 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Volume 1e9e9850-3825-43bf-9c06-90859cb50624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e9e9850-3825-43bf-9c06-90859cb50624', 'volume_size': 1}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183668559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9e9850-3825-43bf-9c06-90859cb50624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46459d28ad2646ef9fe0183979be43ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:46Z,use_quota=True,user_id='ccf1ccb60c2b47218f2f4e46a9b7f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Creating volume 1e9e9850-3825-43bf-9c06-90859cb50624 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:46 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:46 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624 1073741824
Nov 03 08:19:46 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:46 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6" returned: 0 in 0.486s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:46 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6
Nov 03 08:19:46 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:47 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-eb906815-cc04-4953-84b8-bccfe4d6d6e6" returned: 0 in 0.318s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:47 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-quobyte-eb906815-cc04-4953-84b8-bccfe4d6d6e6" released by "delete_volume" :: held 0.933s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624 1073741824" returned: 0 in 0.551s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:47 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624
Nov 03 08:19:47 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Created reservations ['17270dfb-8170-4fc7-8a52-2a464a4c9a91', 'c210f5e4-f60e-4ed5-a9f3-3cec8b555ef4', 'b3ef0ba4-4e28-4967-bccf-ae415b98110b', 'cdab1914-1c76-48ec-9fd4-bba249146acd'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:47 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:47 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:47 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624" returned: 0 in 0.331s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f71fa6-b523-48cf-9ea9-f1d78a13087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e9e9850-3825-43bf-9c06-90859cb50624', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10aff67-74b4-4a33-80d6-373c12b85f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:47 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Volume volume-1e9e9850-3825-43bf-9c06-90859cb50624 (1e9e9850-3825-43bf-9c06-90859cb50624): created successfully
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10aff67-74b4-4a33-80d6-373c12b85f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Flow 'volume_create_manager' (937cef1e-8303-463f-a8f1-9454ef79879d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:47 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a03e8dfe-9e99-47dc-9898-30d382eda22c tempest-ProjectReaderTests-1620375831 None] Created volume successfully.
Nov 03 08:19:47 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.291s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:47 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Deleted volume successfully.
Nov 03 08:19:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-690c7d7c-d8a3-4985-bc4a-e80e52a1c3d1 tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-eb906815-cc04-4953-84b8-bccfe4d6d6e6-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "cinder-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "cinder-quobyte-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:48 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-quobyte-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:48 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58dcaa9-c2fb-4939-8934-9d084eb9e8f4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:48 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd
Nov 03 08:19:48 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:48 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd" returned: 0 in 0.426s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:49 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd
Nov 03 08:19:49 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Acquiring lock "cinder-1e9e9850-3825-43bf-9c06-90859cb50624-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Lock "cinder-1e9e9850-3825-43bf-9c06-90859cb50624-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Acquiring lock "cinder-quobyte-1e9e9850-3825-43bf-9c06-90859cb50624" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Lock "cinder-quobyte-1e9e9850-3825-43bf-9c06-90859cb50624" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2c832f-da12-4f71-8b8a-d399f601ba19]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:49 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd" returned: 0 in 0.311s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-quobyte-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd" released by "delete_volume" :: held 0.790s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:49 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624
Nov 03 08:19:49 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Created reservations ['87211d8e-95a3-4bcf-a1cd-23e70ad37666', 'ab33d917-db18-47b3-a65e-28488fc99d71', '080f2fe8-5d27-48e2-b63c-4fc388a3813a', '99ee0f8a-05b1-49cd-a522-f3c531aaf637'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (7fb90812-ed57-42ba-9f51-c25776705063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce9dd63-0d09-4aab-8ede-22ac83db48a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:49 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce9dd63-0d09-4aab-8ede-22ac83db48a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417443296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5773dd69-381a-4504-88ae-b4a1a2a09f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:49Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:49 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a3f8a9-ded2-41f9-b50b-03450a00da76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a3f8a9-ded2-41f9-b50b-03450a00da76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1bb233-3d2b-4167-a9ec-bb8b78272d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1bb233-3d2b-4167-a9ec-bb8b78272d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5773dd69-381a-4504-88ae-b4a1a2a09f37', 'volume_name': 'volume-5773dd69-381a-4504-88ae-b4a1a2a09f37', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed7ac35-cd3a-4c5c-b12a-48557935dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed7ac35-cd3a-4c5c-b12a-48557935dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7b792d-b2bc-4db6-becd-2333495058a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:49 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Volume 5773dd69-381a-4504-88ae-b4a1a2a09f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5773dd69-381a-4504-88ae-b4a1a2a09f37', 'volume_size': 1}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417443296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5773dd69-381a-4504-88ae-b4a1a2a09f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:49Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Creating volume 5773dd69-381a-4504-88ae-b4a1a2a09f37 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:49 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:49 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 1073741824
Nov 03 08:19:49 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:49 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624" returned: 0 in 0.414s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:49 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624
Nov 03 08:19:49 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:49 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.300s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:49 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Deleted volume successfully.
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-6173fa5d-b583-4b25-b41f-0cdd513be91c tempest-CinderUnicodeTest-1419813689 None] Lock "cinder-6c56611f-60fc-4ea2-81b9-cc1ee1f025bd-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:49 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1e9e9850-3825-43bf-9c06-90859cb50624" returned: 0 in 0.294s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Lock "cinder-quobyte-1e9e9850-3825-43bf-9c06-90859cb50624" released by "delete_volume" :: held 0.761s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Created reservations ['5ee27fbc-5871-4850-9025-768422510181', '161789bb-ea5e-4fe2-9d80-77cd95122fd4', 'f0493a57-db9f-4b15-ac2e-f35a7a70271d', 'a8e71ef4-f713-432f-a1e6-9e149e005051'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:50 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 1073741824" returned: 0 in 0.530s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:50 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:50 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:50 devstack sudo[106454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37
Nov 03 08:19:50 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:50 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.419s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:50 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Deleted volume successfully.
Nov 03 08:19:50 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-337b867e-f016-4707-9a78-630f54a9e11c tempest-ProjectReaderTests-1620375831 None] Lock "cinder-1e9e9850-3825-43bf-9c06-90859cb50624-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37" returned: 0 in 0.422s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7b792d-b2bc-4db6-becd-2333495058a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5773dd69-381a-4504-88ae-b4a1a2a09f37', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe395a36-1090-4e61-b3d1-7c2a53c9527a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:50 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Volume volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 (5773dd69-381a-4504-88ae-b4a1a2a09f37): created successfully
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe395a36-1090-4e61-b3d1-7c2a53c9527a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:50 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (7fb90812-ed57-42ba-9f51-c25776705063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:50 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a69aa5ac-3a07-4473-90c4-6cd6040fff96 tempest-ProjectMemberTests-1029982073 None] Created volume successfully.
Nov 03 08:19:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Creating offline snapshot 348daac6-7f60-4f51-8b21-cf732e049475 of volume 5773dd69-381a-4504-88ae-b4a1a2a09f37 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:19:52 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a02991-cf00-4a14-aa76-831d98af089f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:52 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37
Nov 03 08:19:52 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:52 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37" returned: 0 in 0.502s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:52 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475 1G
Nov 03 08:19:52 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:53 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475 1G" returned: 0 in 0.554s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:53 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475
Nov 03 08:19:53 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:53 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475" returned: 0 in 0.308s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:53 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475 is being set with open permissions: ugo+rw
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:53 devstack sudo[106474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475
Nov 03 08:19:53 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:53 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475" returned: 0 in 0.238s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=222,cinder:UPDATE=323,cinder:INSERT=88,cinder:DELETE=33 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:53 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.info
Nov 03 08:19:53 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:53 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.info" returned: 0 in 0.264s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:53 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.info is being set with open permissions: ugo+rw
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:53 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.info
Nov 03 08:19:53 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Flow 'volume_create_manager' (682545d0-2a9d-4bf3-acf0-7388b524e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:53 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78e1e1b-b48b-429b-9401-6b63b10136ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78e1e1b-b48b-429b-9401-6b63b10136ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100013384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e905406c-69a4-416b-a8d9-48649eadb064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fff493548a4c1fb76b8a393af8990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:54Z,use_quota=True,user_id='fbf8bd72696d42e6950a5b6a42924ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3dd5061-2a37-42be-8958-f2bffaf7beeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3dd5061-2a37-42be-8958-f2bffaf7beeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1d296d-daa5-47aa-a4c1-22eeb6dd659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1d296d-daa5-47aa-a4c1-22eeb6dd659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e905406c-69a4-416b-a8d9-48649eadb064', 'volume_name': 'volume-e905406c-69a4-416b-a8d9-48649eadb064', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db67ee0b-acf3-422f-8a0b-f00254ed1947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db67ee0b-acf3-422f-8a0b-f00254ed1947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd8e76d-bace-4a50-b6b7-b2ade5df8ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:54 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Volume e905406c-69a4-416b-a8d9-48649eadb064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e905406c-69a4-416b-a8d9-48649eadb064', 'volume_size': 1}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:54 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.info" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.149s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100013384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e905406c-69a4-416b-a8d9-48649eadb064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fff493548a4c1fb76b8a393af8990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:54Z,use_quota=True,user_id='fbf8bd72696d42e6950a5b6a42924ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Creating volume e905406c-69a4-416b-a8d9-48649eadb064 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:54 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:54 devstack sudo[106484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064 1073741824
Nov 03 08:19:54 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:54 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-cd2c639e-4799-4001-8fbc-979f9d428612 tempest-ProjectMemberTests-1029982073 None] Create snapshot completed successfully
Nov 03 08:19:54 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064 1073741824" returned: 0 in 0.438s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:54 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064
Nov 03 08:19:54 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:54 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064" returned: 0 in 0.252s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd8e76d-bace-4a50-b6b7-b2ade5df8ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e905406c-69a4-416b-a8d9-48649eadb064', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc560d5b-c73e-4406-9d9f-8d1e079505fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:54 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Volume volume-e905406c-69a4-416b-a8d9-48649eadb064 (e905406c-69a4-416b-a8d9-48649eadb064): created successfully
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc560d5b-c73e-4406-9d9f-8d1e079505fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:54 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Flow 'volume_create_manager' (682545d0-2a9d-4bf3-acf0-7388b524e02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:54 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-05262e37-bf61-4dec-94df-6a8cc73538d8 tempest-ProjectReaderTests-1612162760 None] Created volume successfully.
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-348daac6-7f60-4f51-8b21-cf732e049475-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-348daac6-7f60-4f51-8b21-cf732e049475-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-5773dd69-381a-4504-88ae-b4a1a2a09f37" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-5773dd69-381a-4504-88ae-b4a1a2a09f37" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-348daac6-7f60-4f51-8b21-cf732e049475" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-348daac6-7f60-4f51-8b21-cf732e049475" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Deleting offline snapshot 348daac6-7f60-4f51-8b21-cf732e049475 of volume 5773dd69-381a-4504-88ae-b4a1a2a09f37 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] snapshot_file for this snap is: volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[755e04cb-0f5d-4a18-a1a2-88e856f0c1e2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:55 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475
Nov 03 08:19:55 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:55 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475" returned: 0 in 0.378s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5773dd69-381a-4504-88ae-b4a1a2a09f37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5881755-b22a-45b6-9d1e-f5fc84c271d8]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:55 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37
Nov 03 08:19:55 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:56 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37" returned: 0 in 0.417s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:56 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475
Nov 03 08:19:56 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Creating offline snapshot 53878edc-4cae-4be2-b165-c38914845e69 of volume e905406c-69a4-416b-a8d9-48649eadb064 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9810d923-9671-43d3-ac92-e09322b4fbb9]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:56 devstack sudo[106506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064
Nov 03 08:19:56 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:56 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475" returned: 0 in 0.439s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:56 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475
Nov 03 08:19:56 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:56 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064" returned: 0 in 0.413s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:56 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69 1G
Nov 03 08:19:56 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:56 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37.348daac6-7f60-4f51-8b21-cf732e049475" returned: 0 in 0.287s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-348daac6-7f60-4f51-8b21-cf732e049475" released by "_delete_snapshot" :: held 1.671s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-5773dd69-381a-4504-88ae-b4a1a2a09f37" released by "delete_snapshot" :: held 1.697s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:56 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Created reservations ['80b142bd-7845-46f9-b534-ad6e90502cd3', 'bb193b4d-c13b-4840-bf01-ea620b89f4c0', '095e3a28-83b2-4c5e-ae95-c96927cfd6df', 'f652d27e-3eda-4846-8ad4-7704daa09a87'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:57 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Delete snapshot completed successfully.
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1fc10d86-ba77-4234-bc09-5bc830e808f5 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-348daac6-7f60-4f51-8b21-cf732e049475-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:57 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69 1G" returned: 0 in 0.426s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e905406c-69a4-416b-a8d9-48649eadb064 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:57 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e905406c-69a4-416b-a8d9-48649eadb064 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69
Nov 03 08:19:57 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-5773dd69-381a-4504-88ae-b4a1a2a09f37-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-5773dd69-381a-4504-88ae-b4a1a2a09f37-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-5773dd69-381a-4504-88ae-b4a1a2a09f37" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-5773dd69-381a-4504-88ae-b4a1a2a09f37" acquired by "delete_volume" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[388752d0-f066-4686-bab4-362de3c697a5]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:57 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e905406c-69a4-416b-a8d9-48649eadb064 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69" returned: 0 in 0.323s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:57 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69 is being set with open permissions: ugo+rw
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:57 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69
Nov 03 08:19:57 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:57 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37
Nov 03 08:19:57 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:57 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69" returned: 0 in 0.257s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:57 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.info
Nov 03 08:19:57 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:57 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37" returned: 0 in 0.429s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:57 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37
Nov 03 08:19:57 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:58 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.info" returned: 0 in 0.275s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:58 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.info is being set with open permissions: ugo+rw
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:58 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.info
Nov 03 08:19:58 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:58 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-5773dd69-381a-4504-88ae-b4a1a2a09f37" returned: 0 in 0.306s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-5773dd69-381a-4504-88ae-b4a1a2a09f37" released by "delete_volume" :: held 0.821s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Created reservations ['6fcdd9ea-90b6-417f-bf9c-bc1a2bf89fa7', '69d90e54-cbd3-4550-b9d6-2e83cac54fee', '7dcc4e45-c929-4219-9cc1-ebd77ca47ce8', 'fb062474-3839-4d04-a1ee-8e3d20bc3ab4'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:19:58 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.info" returned: 0 in 0.304s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-908fb493-9af7-4fbb-9387-b225c3b02fb3 tempest-ProjectReaderTests-1612162760 None] Create snapshot completed successfully
Nov 03 08:19:58 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:19:58 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:58 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.251s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:19:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Deleted volume successfully.
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c9647f24-d54b-426c-b01b-d29e8e7974d7 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-5773dd69-381a-4504-88ae-b4a1a2a09f37-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (3cf428a7-8c44-49b5-babe-3cc27054c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:58 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c61d7d-2779-4a09-908b-f805ac8d32c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c61d7d-2779-4a09-908b-f805ac8d32c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1694526057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae51c7e-3bce-4aa0-b69d-83bacc68f2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:59Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6e4f3e-efd8-48ab-b9ce-013fe076ec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6e4f3e-efd8-48ab-b9ce-013fe076ec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c2c8bd-ef92-4d7a-9c35-73edb532c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c2c8bd-ef92-4d7a-9c35-73edb532c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae51c7e-3bce-4aa0-b69d-83bacc68f2f7', 'volume_name': 'volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484b8079-8a58-4343-974d-c78347900f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484b8079-8a58-4343-974d-c78347900f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177c6e44-facc-4b14-b20d-d1e1a0e26926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:59 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Volume bae51c7e-3bce-4aa0-b69d-83bacc68f2f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7', 'volume_size': 1}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1694526057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae51c7e-3bce-4aa0-b69d-83bacc68f2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:59Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Creating volume bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:19:59 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:59 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 1073741824
Nov 03 08:19:59 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:59 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 1073741824" returned: 0 in 0.444s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:59 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7
Nov 03 08:19:59 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-53878edc-4cae-4be2-b165-c38914845e69-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-53878edc-4cae-4be2-b165-c38914845e69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-e905406c-69a4-416b-a8d9-48649eadb064" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-e905406c-69a4-416b-a8d9-48649eadb064" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-53878edc-4cae-4be2-b165-c38914845e69" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-53878edc-4cae-4be2-b165-c38914845e69" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Deleting offline snapshot 53878edc-4cae-4be2-b165-c38914845e69 of volume e905406c-69a4-416b-a8d9-48649eadb064 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] snapshot_file for this snap is: volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a10adb6-bbd9-4023-b1c5-f687651c6c1f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:19:59 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" returned: 0 in 0.304s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177c6e44-facc-4b14-b20d-d1e1a0e26926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f1d6cc-d968-4464-97c1-a6377224508f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:19:59 devstack sudo[106555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69
Nov 03 08:19:59 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:19:59 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Volume volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 (bae51c7e-3bce-4aa0-b69d-83bacc68f2f7): created successfully
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f1d6cc-d968-4464-97c1-a6377224508f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:19:59 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (3cf428a7-8c44-49b5-babe-3cc27054c901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:19:59 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8665da41-70d9-41f1-875d-35c9a0546eba tempest-ProjectMemberTests-1029982073 None] Created volume successfully.
Nov 03 08:20:00 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69" returned: 0 in 0.372s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e905406c-69a4-416b-a8d9-48649eadb064(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:00 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[75765780-7993-4df5-82c0-2d1b5b935009]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:00 devstack sudo[106561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064
Nov 03 08:20:00 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:00 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064" returned: 0 in 0.373s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:00 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69
Nov 03 08:20:00 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:00 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69" returned: 0 in 0.323s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:00 devstack sudo[106571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69
Nov 03 08:20:00 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:01 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064.53878edc-4cae-4be2-b165-c38914845e69" returned: 0 in 0.255s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-53878edc-4cae-4be2-b165-c38914845e69" released by "_delete_snapshot" :: held 1.448s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-e905406c-69a4-416b-a8d9-48649eadb064" released by "delete_snapshot" :: held 1.476s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Creating offline snapshot d79ba457-296c-40f8-a3c9-b4a55b465f6f of volume bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ed1627-2f62-488b-b7cb-f60cb900d550]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Created reservations ['b9a22a63-2cda-4051-abd5-99ace15b7c5a', '01120478-e014-4938-a0bc-d13ab2b5d039', '7d8d9280-9016-4f2e-b36e-0e1a43e205c3', '7f6fecb3-819c-4c52-8b86-da1e1a29a2ed'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:01 devstack sudo[106574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7
Nov 03 08:20:01 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Delete snapshot completed successfully.
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-8f2a0ac2-4ddd-4ae4-bed7-279618a6c067 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-53878edc-4cae-4be2-b165-c38914845e69-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:01 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" returned: 0 in 0.407s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:01 devstack sudo[106580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f 1G
Nov 03 08:20:01 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-e905406c-69a4-416b-a8d9-48649eadb064-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-e905406c-69a4-416b-a8d9-48649eadb064-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-e905406c-69a4-416b-a8d9-48649eadb064" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-e905406c-69a4-416b-a8d9-48649eadb064" acquired by "delete_volume" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb3adf7-76fb-4c1e-812c-56d17b4936ec]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:02 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064
Nov 03 08:20:02 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:02 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f 1G" returned: 0 in 0.470s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:02 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f
Nov 03 08:20:02 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:02 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064" returned: 0 in 0.462s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:02 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064
Nov 03 08:20:02 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:02 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f" returned: 0 in 0.339s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:02 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f is being set with open permissions: ugo+rw
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:02 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f
Nov 03 08:20:02 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:02 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e905406c-69a4-416b-a8d9-48649eadb064" returned: 0 in 0.254s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-e905406c-69a4-416b-a8d9-48649eadb064" released by "delete_volume" :: held 0.777s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:02 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Created reservations ['303d21a4-b898-49fb-8e30-f1c892a1c30e', '1b048456-98ec-4f99-954d-9da522f8dfee', '74fafbcc-9f74-46b8-8817-34d82042e179', '053dfc6b-aa4d-4053-a60e-8aec61f5bb95'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:02 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.info
Nov 03 08:20:02 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:02 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:02 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:03 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.info" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:03 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.info is being set with open permissions: ugo+rw
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:03 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.info
Nov 03 08:20:03 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:03 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.270s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:03 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Deleted volume successfully.
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1527291e-1b61-4e44-a92d-5785cca07d37 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-e905406c-69a4-416b-a8d9-48649eadb064-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:03 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:03 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:03 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.info" returned: 0 in 0.364s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:03 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9c89542c-9e8a-4c20-ad85-91ecb762b083 tempest-ProjectMemberTests-1029982073 None] Create snapshot completed successfully
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Flow 'volume_create_manager' (977405b8-0d15-4095-9e3d-80e6a4d148c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ea36cf-9d8b-4137-ad63-2bc64b26c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:03 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ea36cf-9d8b-4137-ad63-2bc64b26c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1737223120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80da773-6fa8-42e2-b389-dd6c259b4624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fff493548a4c1fb76b8a393af8990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:03Z,use_quota=True,user_id='fbf8bd72696d42e6950a5b6a42924ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499d73a6-dccd-4807-9430-c8397bb0bebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499d73a6-dccd-4807-9430-c8397bb0bebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9e86d8-510d-46a6-8663-476560f6de2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9e86d8-510d-46a6-8663-476560f6de2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e80da773-6fa8-42e2-b389-dd6c259b4624', 'volume_name': 'volume-e80da773-6fa8-42e2-b389-dd6c259b4624', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63415720-bc46-43e9-bc9f-98f677b0e754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63415720-bc46-43e9-bc9f-98f677b0e754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83936bf-e1d8-4f5c-946d-57f5e6bbfec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:03 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Volume e80da773-6fa8-42e2-b389-dd6c259b4624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e80da773-6fa8-42e2-b389-dd6c259b4624', 'volume_size': 1}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1737223120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80da773-6fa8-42e2-b389-dd6c259b4624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fff493548a4c1fb76b8a393af8990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:03Z,use_quota=True,user_id='fbf8bd72696d42e6950a5b6a42924ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Creating volume e80da773-6fa8-42e2-b389-dd6c259b4624 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:20:03 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.391s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:20:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:20:03 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624 1073741824
Nov 03 08:20:03 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:04 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624 1073741824" returned: 0 in 0.435s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:04 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624
Nov 03 08:20:04 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:04 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624" returned: 0 in 0.250s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83936bf-e1d8-4f5c-946d-57f5e6bbfec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80da773-6fa8-42e2-b389-dd6c259b4624', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e30f65-01e4-41c4-87f3-5c4231b83f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:04 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Volume volume-e80da773-6fa8-42e2-b389-dd6c259b4624 (e80da773-6fa8-42e2-b389-dd6c259b4624): created successfully
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e30f65-01e4-41c4-87f3-5c4231b83f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Flow 'volume_create_manager' (977405b8-0d15-4095-9e3d-80e6a4d148c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:04 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a8fb543d-697a-4f3b-927c-d41fe75bee3b tempest-ProjectReaderTests-1612162760 None] Created volume successfully.
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-d79ba457-296c-40f8-a3c9-b4a55b465f6f-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Lock "cinder-d79ba457-296c-40f8-a3c9-b4a55b465f6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-d79ba457-296c-40f8-a3c9-b4a55b465f6f" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-d79ba457-296c-40f8-a3c9-b4a55b465f6f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Deleting offline snapshot d79ba457-296c-40f8-a3c9-b4a55b465f6f of volume bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] snapshot_file for this snap is: volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e974c43-9c4b-4a8b-bdf2-ad4aa266dac7]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:04 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f
Nov 03 08:20:04 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Creating offline snapshot e55fc97d-1a34-4644-9863-4ca9940b64e3 of volume e80da773-6fa8-42e2-b389-dd6c259b4624 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb4f5fb-db70-4134-b766-20a72a034d0f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:04 devstack sudo[106626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624
Nov 03 08:20:04 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:04 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f" returned: 0 in 0.421s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7292f1-0d8a-48eb-b81e-a36c5462e1db]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:05 devstack sudo[106631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7
Nov 03 08:20:05 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:05 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624" returned: 0 in 0.417s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:05 devstack sudo[106636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3 1G
Nov 03 08:20:05 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:05 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" returned: 0 in 0.417s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:05 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f
Nov 03 08:20:05 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:05 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3 1G" returned: 0 in 0.453s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e80da773-6fa8-42e2-b389-dd6c259b4624 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:05 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e80da773-6fa8-42e2-b389-dd6c259b4624 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3
Nov 03 08:20:05 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:05 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f" returned: 0 in 0.409s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:05 devstack sudo[106654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f
Nov 03 08:20:05 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:05 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e80da773-6fa8-42e2-b389-dd6c259b4624 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3" returned: 0 in 0.339s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:05 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3 is being set with open permissions: ugo+rw
Nov 03 08:20:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:06 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3
Nov 03 08:20:06 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:06 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7.d79ba457-296c-40f8-a3c9-b4a55b465f6f" returned: 0 in 0.262s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-d79ba457-296c-40f8-a3c9-b4a55b465f6f" released by "_delete_snapshot" :: held 1.682s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" released by "delete_snapshot" :: held 1.707s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Created reservations ['f6a04a69-efe5-4c9c-893b-84eaf54d1bda', 'b66a4dc3-a503-41cb-88e9-3f92aa5e4843', '9e31967c-bb22-4773-8504-dcc0212170bd', 'f342b3b0-01ec-40bd-9860-1fd8993b2c81'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:06 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3" returned: 0 in 0.282s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:06 devstack sudo[106663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.info
Nov 03 08:20:06 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Delete snapshot completed successfully.
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-90fbf072-bdf5-4fed-a344-0a539d39e0db tempest-ProjectMemberTests-1029982073 None] Lock "cinder-d79ba457-296c-40f8-a3c9-b4a55b465f6f-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:06 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.info" returned: 0 in 0.270s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:06 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.info is being set with open permissions: ugo+rw
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:06 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.info
Nov 03 08:20:06 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[671425a6-1b27-42bb-8041-d6afb93463ed]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:06 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.info" returned: 0 in 0.282s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d55370b9-67f3-4246-9b03-6a64fb6b4564 tempest-ProjectReaderTests-1612162760 None] Create snapshot completed successfully
Nov 03 08:20:06 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7
Nov 03 08:20:06 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:07 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" returned: 0 in 0.395s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:07 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7
Nov 03 08:20:07 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:07 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" returned: 0 in 0.253s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7" released by "delete_volume" :: held 0.736s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Created reservations ['c02dd47c-39af-4b8c-941a-ec84842f8596', '07bb88b8-956b-4bd7-ba43-50638afc5858', '363c75e4-09d2-4c07-b934-7366183d7797', '3d6a8c93-080b-4f8b-bbb9-8b42094b1d07'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:07 devstack sudo[106677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:07 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:07 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.253s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:07 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Deleted volume successfully.
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d26781ab-743f-44c8-a8b8-b5eb0d684f99 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-bae51c7e-3bce-4aa0-b69d-83bacc68f2f7-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-e55fc97d-1a34-4644-9863-4ca9940b64e3-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Lock "cinder-e55fc97d-1a34-4644-9863-4ca9940b64e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-e80da773-6fa8-42e2-b389-dd6c259b4624" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-e80da773-6fa8-42e2-b389-dd6c259b4624" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-e55fc97d-1a34-4644-9863-4ca9940b64e3" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-e55fc97d-1a34-4644-9863-4ca9940b64e3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Deleting offline snapshot e55fc97d-1a34-4644-9863-4ca9940b64e3 of volume e80da773-6fa8-42e2-b389-dd6c259b4624 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] snapshot_file for this snap is: volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bce159-2191-43ab-9753-244e89a7b133]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:08 devstack sudo[106680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3
Nov 03 08:20:08 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (23b98349-1672-4795-98d9-0ffd50088015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2bc1d0-029b-4853-bd8c-664b49212b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2bc1d0-029b-4853-bd8c-664b49212b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007063592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93f85a4-36df-4e03-8423-bf0f1ee38052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:08Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878c7679-9867-49da-bb3a-83351d3a68ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878c7679-9867-49da-bb3a-83351d3a68ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f68236f-21eb-4a6d-9b1e-4589b023019f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f68236f-21eb-4a6d-9b1e-4589b023019f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93f85a4-36df-4e03-8423-bf0f1ee38052', 'volume_name': 'volume-e93f85a4-36df-4e03-8423-bf0f1ee38052', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f4f3fd-283f-48b4-b7f3-f473d7fd5b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f4f3fd-283f-48b4-b7f3-f473d7fd5b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90934511-b927-4d9f-bbb8-c9a1d9256309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:08 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Volume e93f85a4-36df-4e03-8423-bf0f1ee38052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93f85a4-36df-4e03-8423-bf0f1ee38052', 'volume_size': 1}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007063592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93f85a4-36df-4e03-8423-bf0f1ee38052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:08Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Creating volume e93f85a4-36df-4e03-8423-bf0f1ee38052 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:20:08 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:08 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3" returned: 0 in 0.443s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e80da773-6fa8-42e2-b389-dd6c259b4624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:08 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 1073741824
Nov 03 08:20:08 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e69a3d4-1ba9-40f0-b7e0-ff0a28018945]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:08 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624
Nov 03 08:20:08 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:08 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624" returned: 0 in 0.380s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:08 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 1073741824" returned: 0 in 0.454s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:08 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3
Nov 03 08:20:08 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:09 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052
Nov 03 08:20:09 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:09 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052" returned: 0 in 0.281s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90934511-b927-4d9f-bbb8-c9a1d9256309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93f85a4-36df-4e03-8423-bf0f1ee38052', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17157a06-0629-4d69-afcb-01aa15409d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:09 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Volume volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 (e93f85a4-36df-4e03-8423-bf0f1ee38052): created successfully
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17157a06-0629-4d69-afcb-01aa15409d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (23b98349-1672-4795-98d9-0ffd50088015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:09 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3" returned: 0 in 0.397s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-907e0c22-ced3-4f41-b081-5227004dfd5c tempest-ProjectMemberTests-1029982073 None] Created volume successfully.
Nov 03 08:20:09 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3
Nov 03 08:20:09 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:09 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624.e55fc97d-1a34-4644-9863-4ca9940b64e3" returned: 0 in 0.268s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-e55fc97d-1a34-4644-9863-4ca9940b64e3" released by "_delete_snapshot" :: held 1.620s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-e80da773-6fa8-42e2-b389-dd6c259b4624" released by "delete_snapshot" :: held 1.645s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Created reservations ['990869f2-5b28-4b5e-9b46-3a4a1637fc0a', '3f6620f9-3f0a-4a90-8c4d-7e73e28e4781', 'd2c993be-9467-4854-8db2-ac9f69b92e1b', '244f5329-fbb8-410a-ba98-0a9b1efb3258'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Delete snapshot completed successfully.
Nov 03 08:20:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bcd5a3d5-99bc-4dac-911c-6626e42a95ca tempest-ProjectReaderTests-1612162760 None] Lock "cinder-e55fc97d-1a34-4644-9863-4ca9940b64e3-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-e80da773-6fa8-42e2-b389-dd6c259b4624-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Lock "cinder-e80da773-6fa8-42e2-b389-dd6c259b4624-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-e80da773-6fa8-42e2-b389-dd6c259b4624" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-e80da773-6fa8-42e2-b389-dd6c259b4624" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce01e60-b2b9-446d-82c9-51f4c01b3b13]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:10 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624
Nov 03 08:20:10 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Creating offline snapshot 1f5ef270-38bb-425b-a713-76b9ed1d592b of volume e93f85a4-36df-4e03-8423-bf0f1ee38052 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b701232-5cb6-4f98-816e-efd9c5996d04]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:10 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624" returned: 0 in 0.420s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:10 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624
Nov 03 08:20:10 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:10 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052
Nov 03 08:20:10 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:10 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e80da773-6fa8-42e2-b389-dd6c259b4624" returned: 0 in 0.280s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-e80da773-6fa8-42e2-b389-dd6c259b4624" released by "delete_volume" :: held 0.774s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:11 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052" returned: 0 in 0.411s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Created reservations ['cd77f859-4452-4533-94f2-207ee15041ee', '063482f6-8b2a-478b-bbb9-a1f291dc38be', 'e85632d1-5775-4024-aa4b-39e0abe9e858', '59588c13-1e88-45c5-9c49-bfee757c8bf7'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:11 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b 1G
Nov 03 08:20:11 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:11 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:11 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:11 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.321s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:11 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Deleted volume successfully.
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-a9f113d0-d990-4832-aefc-2940d1e4700e tempest-ProjectReaderTests-1612162760 None] Lock "cinder-e80da773-6fa8-42e2-b389-dd6c259b4624-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:11 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b 1G" returned: 0 in 0.609s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:11 devstack sudo[106730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b
Nov 03 08:20:11 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Flow 'volume_create_manager' (2f23fab8-f4f5-44f0-8b1c-d2038b1a7883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60615568-c6a0-4a82-888f-031a6ddebdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60615568-c6a0-4a82-888f-031a6ddebdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668148326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36b258b-cfd4-469a-acca-ea01e693ab39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fff493548a4c1fb76b8a393af8990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:12Z,use_quota=True,user_id='fbf8bd72696d42e6950a5b6a42924ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05144aad-0423-4a0e-a4cf-88d5a3093d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05144aad-0423-4a0e-a4cf-88d5a3093d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4920a4fb-0e35-4a7b-8d4f-c75e66465dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4920a4fb-0e35-4a7b-8d4f-c75e66465dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a36b258b-cfd4-469a-acca-ea01e693ab39', 'volume_name': 'volume-a36b258b-cfd4-469a-acca-ea01e693ab39', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb2638e-2f62-44f8-a622-68785de1efe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb2638e-2f62-44f8-a622-68785de1efe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdb0801-4da8-43aa-936f-702bcaf54cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:11 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Volume a36b258b-cfd4-469a-acca-ea01e693ab39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a36b258b-cfd4-469a-acca-ea01e693ab39', 'volume_size': 1}
Nov 03 08:20:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:12 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b" returned: 0 in 0.355s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:12 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b is being set with open permissions: ugo+rw
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:12 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b
Nov 03 08:20:12 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:12 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b" returned: 0 in 0.255s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:12 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.info
Nov 03 08:20:12 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:12 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.info" returned: 0 in 0.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:12 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.info is being set with open permissions: ugo+rw
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:12 devstack sudo[106741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.info
Nov 03 08:20:12 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:12 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.info" returned: 0 in 0.265s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.920s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668148326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36b258b-cfd4-469a-acca-ea01e693ab39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fff493548a4c1fb76b8a393af8990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:12Z,use_quota=True,user_id='fbf8bd72696d42e6950a5b6a42924ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Creating volume a36b258b-cfd4-469a-acca-ea01e693ab39 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:20:12 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:20:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:12 devstack sudo[106744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39 1073741824
Nov 03 08:20:12 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d58605ad-e84f-4b2f-90a9-bb85cdd2f7e3 tempest-ProjectMemberTests-1029982073 None] Create snapshot completed successfully
Nov 03 08:20:13 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39 1073741824" returned: 0 in 0.456s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:13 devstack sudo[106750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39
Nov 03 08:20:13 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:13 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39" returned: 0 in 0.249s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdb0801-4da8-43aa-936f-702bcaf54cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36b258b-cfd4-469a-acca-ea01e693ab39', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d19e43-a93a-4e73-b9e5-5c0145856ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:13 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Volume volume-a36b258b-cfd4-469a-acca-ea01e693ab39 (a36b258b-cfd4-469a-acca-ea01e693ab39): created successfully
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d19e43-a93a-4e73-b9e5-5c0145856ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Flow 'volume_create_manager' (2f23fab8-f4f5-44f0-8b1c-d2038b1a7883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:13 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d41a5251-9a9c-4c51-81e5-bc22d54117c0 tempest-ProjectReaderTests-1612162760 None] Created volume successfully.
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-1f5ef270-38bb-425b-a713-76b9ed1d592b-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Lock "cinder-1f5ef270-38bb-425b-a713-76b9ed1d592b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-e93f85a4-36df-4e03-8423-bf0f1ee38052" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-e93f85a4-36df-4e03-8423-bf0f1ee38052" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-1f5ef270-38bb-425b-a713-76b9ed1d592b" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-1f5ef270-38bb-425b-a713-76b9ed1d592b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Deleting offline snapshot 1f5ef270-38bb-425b-a713-76b9ed1d592b of volume e93f85a4-36df-4e03-8423-bf0f1ee38052 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] snapshot_file for this snap is: volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bc426d-8548-4c98-aa2a-c1d3615115d0]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:13 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:14 devstack sudo[106753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b
Nov 03 08:20:14 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Creating offline snapshot 2db75161-7f84-46c0-8de5-d3ebaab5788e of volume a36b258b-cfd4-469a-acca-ea01e693ab39 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c939cfe-2c73-4124-88b6-1c1d7c121722]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:14 devstack sudo[106756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39
Nov 03 08:20:14 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:14 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b" returned: 0 in 0.440s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93f85a4-36df-4e03-8423-bf0f1ee38052(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5b177d-47c0-4a75-b150-409b1d1edf9b]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:14 devstack sudo[106761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052
Nov 03 08:20:14 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:14 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39" returned: 0 in 0.414s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:14 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e 1G
Nov 03 08:20:14 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:14 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052" returned: 0 in 0.411s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:14 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b
Nov 03 08:20:14 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:15 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e 1G" returned: 0 in 0.498s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a36b258b-cfd4-469a-acca-ea01e693ab39 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:15 devstack sudo[106780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a36b258b-cfd4-469a-acca-ea01e693ab39 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e
Nov 03 08:20:15 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:15 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b" returned: 0 in 0.440s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:15 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b
Nov 03 08:20:15 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:15 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a36b258b-cfd4-469a-acca-ea01e693ab39 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e" returned: 0 in 0.338s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:15 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e is being set with open permissions: ugo+rw
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:15 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e
Nov 03 08:20:15 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:15 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052.1f5ef270-38bb-425b-a713-76b9ed1d592b" returned: 0 in 0.268s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-1f5ef270-38bb-425b-a713-76b9ed1d592b" released by "_delete_snapshot" :: held 1.714s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-e93f85a4-36df-4e03-8423-bf0f1ee38052" released by "delete_snapshot" :: held 1.739s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Created reservations ['7fd44b43-b8a1-4be9-aeba-60c865c426d3', '162338f3-4fd9-44f7-a683-33a9a053e8a5', 'b014cfb8-f593-4c12-97ff-88c1b09678f6', '7643de9e-ab50-4095-bb3d-912bcba94941'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:15 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e" returned: 0 in 0.261s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:15 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Delete snapshot completed successfully.
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-73d8cad4-687a-4dde-9773-997281f2f59e tempest-ProjectMemberTests-1029982073 None] Lock "cinder-1f5ef270-38bb-425b-a713-76b9ed1d592b-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:15 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.info
Nov 03 08:20:15 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:15 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-e93f85a4-36df-4e03-8423-bf0f1ee38052-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.info" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:15 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.info is being set with open permissions: ugo+rw
Nov 03 08:20:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Lock "cinder-e93f85a4-36df-4e03-8423-bf0f1ee38052-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:16 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.info
Nov 03 08:20:16 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-e93f85a4-36df-4e03-8423-bf0f1ee38052" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-e93f85a4-36df-4e03-8423-bf0f1ee38052" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[222ec314-853d-4ffa-9c86-9c9188bb2f3a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:16 devstack sudo[106799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052
Nov 03 08:20:16 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:16 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.info" returned: 0 in 0.273s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:16 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d9325d66-c4ef-4145-a850-f77c3c5caf63 tempest-ProjectReaderTests-1612162760 None] Create snapshot completed successfully
Nov 03 08:20:16 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052" returned: 0 in 0.380s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:16 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052
Nov 03 08:20:16 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:16 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-e93f85a4-36df-4e03-8423-bf0f1ee38052" returned: 0 in 0.238s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-e93f85a4-36df-4e03-8423-bf0f1ee38052" released by "delete_volume" :: held 0.682s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Created reservations ['492b679e-4dca-43ce-b3e7-07f7be1f9b78', '29fc6e25-300e-4ba2-af53-31f5a7fce609', 'dfe63198-674a-435b-b307-da2961b17b27', 'd14d8726-145c-4057-a099-02e182fd4bc8'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:16 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:16 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:17 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.253s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Deleted volume successfully.
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-33939fdd-5a75-4ad2-9253-9972a55ad48f tempest-ProjectMemberTests-1029982073 None] Lock "cinder-e93f85a4-36df-4e03-8423-bf0f1ee38052-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-2db75161-7f84-46c0-8de5-d3ebaab5788e-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-2db75161-7f84-46c0-8de5-d3ebaab5788e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-a36b258b-cfd4-469a-acca-ea01e693ab39" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-a36b258b-cfd4-469a-acca-ea01e693ab39" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-2db75161-7f84-46c0-8de5-d3ebaab5788e" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-2db75161-7f84-46c0-8de5-d3ebaab5788e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Deleting offline snapshot 2db75161-7f84-46c0-8de5-d3ebaab5788e of volume a36b258b-cfd4-469a-acca-ea01e693ab39 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] snapshot_file for this snap is: volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc05bf1d-2a76-40a2-bb99-890299c38fed]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:17 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e
Nov 03 08:20:17 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (7b8e94c3-dea5-4c43-8596-834ec82c272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4740fa-ec92-4cb7-8592-16cc13f9d2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4740fa-ec92-4cb7-8592-16cc13f9d2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1750176734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0779252e-07c1-4a46-a253-3aea4fdb22ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:18Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd81c04-f112-432f-b52d-07ca7c8e2009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd81c04-f112-432f-b52d-07ca7c8e2009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f6ff4f-4fd4-4763-a7fa-e3fe1f566a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f6ff4f-4fd4-4763-a7fa-e3fe1f566a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0779252e-07c1-4a46-a253-3aea4fdb22ff', 'volume_name': 'volume-0779252e-07c1-4a46-a253-3aea4fdb22ff', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7c0474-6193-44f0-b12e-577d771319a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7c0474-6193-44f0-b12e-577d771319a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc6fd29-c58b-4bfd-aa86-d4d194e2ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:17 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Volume 0779252e-07c1-4a46-a253-3aea4fdb22ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0779252e-07c1-4a46-a253-3aea4fdb22ff', 'volume_size': 1}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1750176734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0779252e-07c1-4a46-a253-3aea4fdb22ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:18Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Creating volume 0779252e-07c1-4a46-a253-3aea4fdb22ff {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:20:17 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:17 devstack sudo[106817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff 1073741824
Nov 03 08:20:17 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:17 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e" returned: 0 in 0.372s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a36b258b-cfd4-469a-acca-ea01e693ab39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e295eb-4bfc-4ed3-8512-9e40a83fba59]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:17 devstack sudo[106821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39
Nov 03 08:20:17 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:18 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff 1073741824" returned: 0 in 0.413s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:18 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff
Nov 03 08:20:18 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:18 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39" returned: 0 in 0.379s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:18 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e
Nov 03 08:20:18 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:18 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff" returned: 0 in 0.268s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc6fd29-c58b-4bfd-aa86-d4d194e2ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0779252e-07c1-4a46-a253-3aea4fdb22ff', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f81eda-3c70-4085-bfef-a44f796247dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:18 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Volume volume-0779252e-07c1-4a46-a253-3aea4fdb22ff (0779252e-07c1-4a46-a253-3aea4fdb22ff): created successfully
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f81eda-3c70-4085-bfef-a44f796247dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (7b8e94c3-dea5-4c43-8596-834ec82c272e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-327e02f2-54a3-4819-9b6b-29883a800907 tempest-ProjectMemberTests-1029982073 None] Created volume successfully.
Nov 03 08:20:18 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e" returned: 0 in 0.392s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:18 devstack sudo[106846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e
Nov 03 08:20:18 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Creating offline snapshot e417d2d9-cf7c-401d-a620-181fbd507b2f of volume 0779252e-07c1-4a46-a253-3aea4fdb22ff {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3370d3-1114-44a2-a3e5-467b3bc5b5da]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:18 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39.2db75161-7f84-46c0-8de5-d3ebaab5788e" returned: 0 in 0.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-2db75161-7f84-46c0-8de5-d3ebaab5788e" released by "_delete_snapshot" :: held 1.532s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-a36b258b-cfd4-469a-acca-ea01e693ab39" released by "delete_snapshot" :: held 1.557s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:18 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff
Nov 03 08:20:18 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:18 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Created reservations ['62ea3440-892b-4d13-8a8a-56b1c5adabed', '1fe92ec2-1cbe-496e-8651-b24f26213cb2', 'f8d3b2f0-3a71-4d06-bc24-37556381babe', '8d0e1455-ec1b-4322-8401-be1d046ecf5c'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:19 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Delete snapshot completed successfully.
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-78f5f2e2-9117-48ef-ad06-587f34c4042d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-2db75161-7f84-46c0-8de5-d3ebaab5788e-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:19 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff" returned: 0 in 0.356s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:19 devstack sudo[106854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f 1G
Nov 03 08:20:19 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-a36b258b-cfd4-469a-acca-ea01e693ab39-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-a36b258b-cfd4-469a-acca-ea01e693ab39-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-a36b258b-cfd4-469a-acca-ea01e693ab39" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-a36b258b-cfd4-469a-acca-ea01e693ab39" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7e1499-6c6e-4bd7-aba3-846a082ec8ff]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:19 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f 1G" returned: 0 in 0.457s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0779252e-07c1-4a46-a253-3aea4fdb22ff -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:19 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0779252e-07c1-4a46-a253-3aea4fdb22ff -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f
Nov 03 08:20:19 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:19 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39
Nov 03 08:20:19 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:19 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0779252e-07c1-4a46-a253-3aea4fdb22ff -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f" returned: 0 in 0.299s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:19 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:19 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f is being set with open permissions: ugo+rw
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39" returned: 0 in 0.360s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:19 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f
Nov 03 08:20:19 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:19 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39
Nov 03 08:20:19 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:20 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f" returned: 0 in 0.246s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:20 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-a36b258b-cfd4-469a-acca-ea01e693ab39" returned: 0 in 0.242s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-a36b258b-cfd4-469a-acca-ea01e693ab39" released by "delete_volume" :: held 0.673s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:20 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.info
Nov 03 08:20:20 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Created reservations ['74f8226a-0e22-4f2e-92b0-d6503f9137fc', '82fcbab3-f4d9-4401-8202-038a89e0c0c4', '551a3fdb-fade-46d8-bc4c-2b98a4911a7f', '1196fa21-046f-4790-8e67-887056656351'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:20 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:20 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:20 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.info" returned: 0 in 0.264s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:20 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.info is being set with open permissions: ugo+rw
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:20 devstack sudo[106881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.info
Nov 03 08:20:20 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:20 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.254s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:20 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Deleted volume successfully.
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-629fa0f1-3793-4e01-b478-ed3bc494b66d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-a36b258b-cfd4-469a-acca-ea01e693ab39-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:20 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.info" returned: 0 in 0.269s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:20 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-23a8ee6c-258f-45a6-a876-61b7ad409100 tempest-ProjectMemberTests-1029982073 None] Create snapshot completed successfully
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-e417d2d9-cf7c-401d-a620-181fbd507b2f-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-e417d2d9-cf7c-401d-a620-181fbd507b2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-0779252e-07c1-4a46-a253-3aea4fdb22ff" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-0779252e-07c1-4a46-a253-3aea4fdb22ff" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-e417d2d9-cf7c-401d-a620-181fbd507b2f" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-e417d2d9-cf7c-401d-a620-181fbd507b2f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Deleting offline snapshot e417d2d9-cf7c-401d-a620-181fbd507b2f of volume 0779252e-07c1-4a46-a253-3aea4fdb22ff {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] snapshot_file for this snap is: volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[94201da6-94ac-4aca-a652-44e08c6f7d1d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Flow 'volume_create_manager' (9db9a2d1-78cb-4845-b910-28165f053fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a9808e-ecba-4ce2-ade1-c45503979695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a9808e-ecba-4ce2-ade1-c45503979695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006706918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564a2e3b-31ea-4292-9b41-c9c95d867f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fff493548a4c1fb76b8a393af8990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:21Z,use_quota=True,user_id='fbf8bd72696d42e6950a5b6a42924ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:21 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f
Nov 03 08:20:21 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60abaac7-19c0-44eb-b4f5-00029fadb0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60abaac7-19c0-44eb-b4f5-00029fadb0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2273ce10-c3e0-43fe-bcf1-701b90483194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2273ce10-c3e0-43fe-bcf1-701b90483194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '564a2e3b-31ea-4292-9b41-c9c95d867f40', 'volume_name': 'volume-564a2e3b-31ea-4292-9b41-c9c95d867f40', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c139a85-b5a7-4d29-8c73-21e28e6b85be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c139a85-b5a7-4d29-8c73-21e28e6b85be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b3e84c-6bfd-456f-88bd-59b0464d44be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:21 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Volume 564a2e3b-31ea-4292-9b41-c9c95d867f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-564a2e3b-31ea-4292-9b41-c9c95d867f40', 'volume_size': 1}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006706918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564a2e3b-31ea-4292-9b41-c9c95d867f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fff493548a4c1fb76b8a393af8990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:21Z,use_quota=True,user_id='fbf8bd72696d42e6950a5b6a42924ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Creating volume 564a2e3b-31ea-4292-9b41-c9c95d867f40 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:20:21 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:21 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 1073741824
Nov 03 08:20:21 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:21 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f" returned: 0 in 0.380s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0779252e-07c1-4a46-a253-3aea4fdb22ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbe2d11-7ee3-44c0-a9cf-9f52bcb266af]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:21 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff
Nov 03 08:20:21 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:21 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 1073741824" returned: 0 in 0.441s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:21 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40
Nov 03 08:20:21 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:21 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff" returned: 0 in 0.402s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:21 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f
Nov 03 08:20:21 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:21 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40" returned: 0 in 0.254s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b3e84c-6bfd-456f-88bd-59b0464d44be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564a2e3b-31ea-4292-9b41-c9c95d867f40', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7460cdcd-1411-4dd8-97b9-72ec68bd285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:21 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Volume volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 (564a2e3b-31ea-4292-9b41-c9c95d867f40): created successfully
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7460cdcd-1411-4dd8-97b9-72ec68bd285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Flow 'volume_create_manager' (9db9a2d1-78cb-4845-b910-28165f053fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f03b243d-fbd8-4d06-ae35-fc4ca59a6b0a tempest-ProjectReaderTests-1612162760 None] Created volume successfully.
Nov 03 08:20:22 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f" returned: 0 in 0.366s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:22 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f
Nov 03 08:20:22 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Creating offline snapshot cc08cf1a-0407-44c6-9f7d-edb3dbda073e of volume 564a2e3b-31ea-4292-9b41-c9c95d867f40 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3dd54f-df65-4273-9354-1df789c2e0e0]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:22 devstack sudo[106910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40
Nov 03 08:20:22 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:22 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff.e417d2d9-cf7c-401d-a620-181fbd507b2f" returned: 0 in 0.271s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-e417d2d9-cf7c-401d-a620-181fbd507b2f" released by "_delete_snapshot" :: held 1.529s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-0779252e-07c1-4a46-a253-3aea4fdb22ff" released by "delete_snapshot" :: held 1.559s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Created reservations ['2be289e0-0092-4403-8db5-e8de3f394bee', '1a051007-bc57-42e7-9ca3-1a3fd96753f2', '8cb005e2-866f-461b-95fd-af9bdfc45ef1', '49eafd08-adff-49af-9123-e13809d4d45a'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:22 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Delete snapshot completed successfully.
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-2eb573ce-316f-4888-8640-06920ae1db84 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-e417d2d9-cf7c-401d-a620-181fbd507b2f-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:22 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40" returned: 0 in 0.361s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:22 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e 1G
Nov 03 08:20:22 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:23 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e 1G" returned: 0 in 0.381s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-0779252e-07c1-4a46-a253-3aea4fdb22ff-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:23 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e
Nov 03 08:20:23 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-0779252e-07c1-4a46-a253-3aea4fdb22ff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-0779252e-07c1-4a46-a253-3aea4fdb22ff" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-0779252e-07c1-4a46-a253-3aea4fdb22ff" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa2916c-fea9-45f0-899b-60edf5c85e5c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:23 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff
Nov 03 08:20:23 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:23 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e" returned: 0 in 0.318s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:23 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e is being set with open permissions: ugo+rw
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:23 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e
Nov 03 08:20:23 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:23 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff" returned: 0 in 0.373s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:23 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff
Nov 03 08:20:23 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:23 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e" returned: 0 in 0.253s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:23 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.info
Nov 03 08:20:23 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:23 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-0779252e-07c1-4a46-a253-3aea4fdb22ff" returned: 0 in 0.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-0779252e-07c1-4a46-a253-3aea4fdb22ff" released by "delete_volume" :: held 0.704s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:23 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.info" returned: 0 in 0.257s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:23 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.info is being set with open permissions: ugo+rw
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:23 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Created reservations ['dba89bb3-b357-4574-add3-018fbdd65fdc', 'e933ddd6-445d-4814-94ae-66b780616ba6', '529f72c3-c4a2-4a9a-b202-80920221cbc0', '736e622e-9185-421d-adc0-61f0cb66dc5e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:23 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.info
Nov 03 08:20:24 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:24 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:24 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:24 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.info" returned: 0 in 0.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:24 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e159bd6a-1c48-42c6-86bc-b6d3d9c8fef9 tempest-ProjectReaderTests-1612162760 None] Create snapshot completed successfully
Nov 03 08:20:24 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.265s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:24 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Deleted volume successfully.
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-10a66c05-be23-49cb-a7b4-6fe6b1874734 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-0779252e-07c1-4a46-a253-3aea4fdb22ff-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-cc08cf1a-0407-44c6-9f7d-edb3dbda073e-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-cc08cf1a-0407-44c6-9f7d-edb3dbda073e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-564a2e3b-31ea-4292-9b41-c9c95d867f40" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-564a2e3b-31ea-4292-9b41-c9c95d867f40" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-cc08cf1a-0407-44c6-9f7d-edb3dbda073e" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-cc08cf1a-0407-44c6-9f7d-edb3dbda073e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Deleting offline snapshot cc08cf1a-0407-44c6-9f7d-edb3dbda073e of volume 564a2e3b-31ea-4292-9b41-c9c95d867f40 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] snapshot_file for this snap is: volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[024e6f95-9b8e-4cd2-a4ee-939095d76c79]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:24 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e
Nov 03 08:20:24 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (8e20ddd4-65b1-4d36-85be-9c26ed9195e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0029eb-6369-4f23-baef-71fd3b4bae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0029eb-6369-4f23-baef-71fd3b4bae0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1314019396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49aa16e-29e9-46a0-8140-eb970ad36d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:25Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b7d8fe-0558-4339-92df-d3e1882c5477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b7d8fe-0558-4339-92df-d3e1882c5477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4421c52-9cb3-4b84-955b-8960035e9bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4421c52-9cb3-4b84-955b-8960035e9bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49aa16e-29e9-46a0-8140-eb970ad36d3d', 'volume_name': 'volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfc5be3-cdfc-400e-bbf8-5e33f1a1a679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfc5be3-cdfc-400e-bbf8-5e33f1a1a679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8dd04da-9b31-4da2-b79b-7e1a30a2e4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:24 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Volume b49aa16e-29e9-46a0-8140-eb970ad36d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d', 'volume_size': 1}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1314019396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49aa16e-29e9-46a0-8140-eb970ad36d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:25Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Creating volume b49aa16e-29e9-46a0-8140-eb970ad36d3d {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:20:24 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:24 devstack sudo[106953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d 1073741824
Nov 03 08:20:24 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:24 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e" returned: 0 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:24 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-564a2e3b-31ea-4292-9b41-c9c95d867f40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[894d1ed1-ae85-428c-9ff2-7e6de13f826e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:25 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40
Nov 03 08:20:25 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:25 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d 1073741824" returned: 0 in 0.486s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:25 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40" returned: 0 in 0.408s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:25 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e
Nov 03 08:20:25 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:25 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d
Nov 03 08:20:25 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:25 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d" returned: 0 in 0.279s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8dd04da-9b31-4da2-b79b-7e1a30a2e4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44a60f8-6ee9-496d-bb68-1c94aa710a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:25 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Volume volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d (b49aa16e-29e9-46a0-8140-eb970ad36d3d): created successfully
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44a60f8-6ee9-496d-bb68-1c94aa710a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (8e20ddd4-65b1-4d36-85be-9c26ed9195e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:25 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-bcf0150f-9056-4342-a0c0-e4f492975450 tempest-ProjectMemberTests-1029982073 None] Created volume successfully.
Nov 03 08:20:25 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e" returned: 0 in 0.375s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:25 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:25 devstack sudo[106974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e
Nov 03 08:20:25 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:26 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40.cc08cf1a-0407-44c6-9f7d-edb3dbda073e" returned: 0 in 0.245s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-cc08cf1a-0407-44c6-9f7d-edb3dbda073e" released by "_delete_snapshot" :: held 1.534s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-564a2e3b-31ea-4292-9b41-c9c95d867f40" released by "delete_snapshot" :: held 1.559s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Created reservations ['05e99f1e-bb14-41b7-832e-1ad5fcb83342', 'ef587b0a-f01e-4d32-a35e-7683635d9774', '612317ad-4e83-49b7-adcb-c06ac13f70a7', '8408ed8d-cca0-4b88-9db5-e445bc0d5110'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:26 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Delete snapshot completed successfully.
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-28c1de9d-b3f8-4b1f-9db8-ff4d702cc016 tempest-ProjectReaderTests-1612162760 None] Lock "cinder-cc08cf1a-0407-44c6-9f7d-edb3dbda073e-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-564a2e3b-31ea-4292-9b41-c9c95d867f40-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Lock "cinder-564a2e3b-31ea-4292-9b41-c9c95d867f40-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-564a2e3b-31ea-4292-9b41-c9c95d867f40" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-564a2e3b-31ea-4292-9b41-c9c95d867f40" acquired by "delete_volume" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e65b22-db08-4673-8ac5-b9c9b73e9e14]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:26 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:26 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40
Nov 03 08:20:26 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Creating offline snapshot fdbf4eaa-0d44-4027-804a-c8a896a4afab of volume b49aa16e-29e9-46a0-8140-eb970ad36d3d {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0cb8ba-0cdc-4ba6-b844-bc54833e7b42]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:27 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40" returned: 0 in 0.394s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:27 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40
Nov 03 08:20:27 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:27 devstack sudo[106982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d
Nov 03 08:20:27 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:27 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-564a2e3b-31ea-4292-9b41-c9c95d867f40" returned: 0 in 0.256s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-564a2e3b-31ea-4292-9b41-c9c95d867f40" released by "delete_volume" :: held 0.713s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Created reservations ['acfa9f41-68a9-42ec-b3ad-db702d5a8c3d', '88463419-f591-4263-afa3-8c1e55d7691a', '388d3a5e-eb81-4b87-ace2-fa83430a70e8', '0c042165-d91f-4604-a839-7caff8cb507b'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:27 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d" returned: 0 in 0.385s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:27 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab 1G
Nov 03 08:20:27 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:27 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:27 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:27 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.268s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:27 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Deleted volume successfully.
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-989a0171-68e6-4837-a74c-7f73f1dea92b tempest-ProjectReaderTests-1612162760 None] Lock "cinder-564a2e3b-31ea-4292-9b41-c9c95d867f40-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:27 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab 1G" returned: 0 in 0.472s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:27 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:27 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab
Nov 03 08:20:27 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:28 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab" returned: 0 in 0.345s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:28 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab is being set with open permissions: ugo+rw
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:28 devstack sudo[107004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab
Nov 03 08:20:28 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Flow 'volume_create_manager' (2a637d22-7e51-4eda-8993-50dfdb61cdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c38642-381e-4ff9-879a-0c5b894fabd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c38642-381e-4ff9-879a-0c5b894fabd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046138122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba300b6e-52de-4a4e-8757-5642b867bc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fff493548a4c1fb76b8a393af8990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:28Z,use_quota=True,user_id='fbf8bd72696d42e6950a5b6a42924ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4d06c8-ffd2-4ff8-a242-a4f424238eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4d06c8-ffd2-4ff8-a242-a4f424238eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed62d89-553d-4a39-87fc-d184bc3a6018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed62d89-553d-4a39-87fc-d184bc3a6018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba300b6e-52de-4a4e-8757-5642b867bc65', 'volume_name': 'volume-ba300b6e-52de-4a4e-8757-5642b867bc65', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69314e8-ecf5-4de6-9105-cf648a5810e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69314e8-ecf5-4de6-9105-cf648a5810e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bfe72f-0764-4808-948b-0a004fb5bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:28 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Volume ba300b6e-52de-4a4e-8757-5642b867bc65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba300b6e-52de-4a4e-8757-5642b867bc65', 'volume_size': 1}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:28 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab" returned: 0 in 0.253s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:28 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.info
Nov 03 08:20:28 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:28 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.info" returned: 0 in 0.258s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:28 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.info is being set with open permissions: ugo+rw
Nov 03 08:20:28 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:28 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.info
Nov 03 08:20:28 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:29 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.info" returned: 0 in 0.248s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046138122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba300b6e-52de-4a4e-8757-5642b867bc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5fff493548a4c1fb76b8a393af8990b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:28Z,use_quota=True,user_id='fbf8bd72696d42e6950a5b6a42924ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Creating volume ba300b6e-52de-4a4e-8757-5642b867bc65 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:20:29 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:29 devstack sudo[107013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65 1073741824
Nov 03 08:20:29 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:29 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ee457f9f-7c57-4d94-ba6f-4739780081fb tempest-ProjectMemberTests-1029982073 None] Create snapshot completed successfully
Nov 03 08:20:29 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65 1073741824" returned: 0 in 0.408s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:29 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65
Nov 03 08:20:29 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:29 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65" returned: 0 in 0.250s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bfe72f-0764-4808-948b-0a004fb5bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba300b6e-52de-4a4e-8757-5642b867bc65', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ce833e-6750-4414-9ffe-c194b4744601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:29 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Volume volume-ba300b6e-52de-4a4e-8757-5642b867bc65 (ba300b6e-52de-4a4e-8757-5642b867bc65): created successfully
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ce833e-6750-4414-9ffe-c194b4744601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:29 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Flow 'volume_create_manager' (2a637d22-7e51-4eda-8993-50dfdb61cdd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:29 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4113c36a-f129-4e5e-b957-fdf522467994 tempest-ProjectReaderTests-1612162760 None] Created volume successfully.
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-fdbf4eaa-0d44-4027-804a-c8a896a4afab-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-fdbf4eaa-0d44-4027-804a-c8a896a4afab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-b49aa16e-29e9-46a0-8140-eb970ad36d3d" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-b49aa16e-29e9-46a0-8140-eb970ad36d3d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-fdbf4eaa-0d44-4027-804a-c8a896a4afab" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-fdbf4eaa-0d44-4027-804a-c8a896a4afab" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Deleting offline snapshot fdbf4eaa-0d44-4027-804a-c8a896a4afab of volume b49aa16e-29e9-46a0-8140-eb970ad36d3d {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] snapshot_file for this snap is: volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[614f0726-2481-4891-bd8c-5120fc625935]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:30 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab
Nov 03 08:20:30 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Creating offline snapshot 3ea951b3-0b96-4669-8177-8e6295c8379b of volume ba300b6e-52de-4a4e-8757-5642b867bc65 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99fbbe4-b73d-40b7-a515-832703de77d2]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:30 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:30 devstack sudo[107024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65
Nov 03 08:20:30 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab" returned: 0 in 0.391s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a25d909-feac-444f-b11c-66a412c7ad44]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:30 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d
Nov 03 08:20:30 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:30 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65" returned: 0 in 0.386s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:30 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:30 devstack sudo[107034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b 1G
Nov 03 08:20:30 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:31 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d" returned: 0 in 0.395s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:31 devstack sudo[107039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab
Nov 03 08:20:31 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:31 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b 1G" returned: 0 in 0.416s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba300b6e-52de-4a4e-8757-5642b867bc65 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:31 devstack sudo[107047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba300b6e-52de-4a4e-8757-5642b867bc65 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b
Nov 03 08:20:31 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:31 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab" returned: 0 in 0.392s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:31 devstack sudo[107049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab
Nov 03 08:20:31 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:31 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba300b6e-52de-4a4e-8757-5642b867bc65 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b" returned: 0 in 0.314s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:31 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b is being set with open permissions: ugo+rw
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:31 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b
Nov 03 08:20:31 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:31 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d.fdbf4eaa-0d44-4027-804a-c8a896a4afab" returned: 0 in 0.263s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-fdbf4eaa-0d44-4027-804a-c8a896a4afab" released by "_delete_snapshot" :: held 1.547s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-b49aa16e-29e9-46a0-8140-eb970ad36d3d" released by "delete_snapshot" :: held 1.575s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Created reservations ['5a7e4da4-6f04-42d5-b5b7-f36237e0b708', 'c66517e1-9523-417a-8285-ea6ff757a049', 'ee30f79f-9bd4-4e37-9545-d6fb248f48de', '68dba686-aa3d-4a8b-bca5-292f98315807'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:31 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Delete snapshot completed successfully.
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4a2853d8-8027-4125-a2b7-95f8151b93f8 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-fdbf4eaa-0d44-4027-804a-c8a896a4afab-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:31 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b" returned: 0 in 0.264s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:31 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:32 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.info
Nov 03 08:20:32 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:32 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.info" returned: 0 in 0.254s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:32 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.info is being set with open permissions: ugo+rw
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:32 devstack sudo[107061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.info
Nov 03 08:20:32 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-b49aa16e-29e9-46a0-8140-eb970ad36d3d-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Lock "cinder-b49aa16e-29e9-46a0-8140-eb970ad36d3d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-b49aa16e-29e9-46a0-8140-eb970ad36d3d" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-b49aa16e-29e9-46a0-8140-eb970ad36d3d" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:32 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.info" returned: 0 in 0.260s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff5f7e5-1249-49d6-a019-d99367175d9a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:32 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d3ba9f60-00bf-4bad-be25-a265a17b8b44 tempest-ProjectReaderTests-1612162760 None] Create snapshot completed successfully
Nov 03 08:20:32 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d
Nov 03 08:20:32 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:32 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d" returned: 0 in 0.372s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:32 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:32 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d
Nov 03 08:20:32 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:33 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-b49aa16e-29e9-46a0-8140-eb970ad36d3d" returned: 0 in 0.272s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-b49aa16e-29e9-46a0-8140-eb970ad36d3d" released by "delete_volume" :: held 0.723s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Created reservations ['e50d99bb-e8b8-46fa-be2d-6e7f0f631da5', '3bf08b82-90e7-4f78-8f9b-a903bf64357b', 'c1de9098-363b-4634-aff8-c03aa4d88668', '6649fa96-abc2-4e95-9334-8e12aab80203'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:33 devstack sudo[107073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:33 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:33 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.307s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:33 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Deleted volume successfully.
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-1155d0b6-a006-4562-8d7a-079268d6534f tempest-ProjectMemberTests-1029982073 None] Lock "cinder-b49aa16e-29e9-46a0-8140-eb970ad36d3d-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-3ea951b3-0b96-4669-8177-8e6295c8379b-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-3ea951b3-0b96-4669-8177-8e6295c8379b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-ba300b6e-52de-4a4e-8757-5642b867bc65" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-ba300b6e-52de-4a4e-8757-5642b867bc65" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-3ea951b3-0b96-4669-8177-8e6295c8379b" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-3ea951b3-0b96-4669-8177-8e6295c8379b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Deleting offline snapshot 3ea951b3-0b96-4669-8177-8e6295c8379b of volume ba300b6e-52de-4a4e-8757-5642b867bc65 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] snapshot_file for this snap is: volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bdb0d8-4e17-4e34-8098-c7be297d30e8]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:33 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:33 devstack sudo[107076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b
Nov 03 08:20:33 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (d43bc50f-4d38-4cbc-af70-56f795705d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a145be-da73-43fd-9e8b-723bac0898aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a145be-da73-43fd-9e8b-723bac0898aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1396771339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5b61a2-6c82-46e4-b621-2c808d47fbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:34Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7f3280-501a-4b16-8c36-a26d10a85c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7f3280-501a-4b16-8c36-a26d10a85c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d34511-78e1-4c8f-b6b3-bac0e6988748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d34511-78e1-4c8f-b6b3-bac0e6988748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5b61a2-6c82-46e4-b621-2c808d47fbff', 'volume_name': 'volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6222fd87-4071-44fd-b6a1-5aaac650b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6222fd87-4071-44fd-b6a1-5aaac650b034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4f28e0-bda5-4b0e-878c-4973a789db4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:34 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Volume ef5b61a2-6c82-46e4-b621-2c808d47fbff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff', 'volume_size': 1}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1396771339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5b61a2-6c82-46e4-b621-2c808d47fbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:34Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Creating volume ef5b61a2-6c82-46e4-b621-2c808d47fbff {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:20:34 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:34 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff 1073741824
Nov 03 08:20:34 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:34 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b" returned: 0 in 0.376s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba300b6e-52de-4a4e-8757-5642b867bc65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f7e17b-0d34-46c9-b900-91509bb9ad3c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:34 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65
Nov 03 08:20:34 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:34 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff 1073741824" returned: 0 in 0.440s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:34 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65" returned: 0 in 0.382s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:34 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b
Nov 03 08:20:34 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:34 devstack sudo[107094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff
Nov 03 08:20:34 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:34 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff" returned: 0 in 0.259s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4f28e0-bda5-4b0e-878c-4973a789db4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63130e0-a0d7-4e01-80d3-713038860e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:34 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Volume volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff (ef5b61a2-6c82-46e4-b621-2c808d47fbff): created successfully
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63130e0-a0d7-4e01-80d3-713038860e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (d43bc50f-4d38-4cbc-af70-56f795705d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:34 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b" returned: 0 in 0.347s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:34 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7fa0e3c7-a816-4dd9-8410-5e2a677d23aa tempest-ProjectMemberTests-1029982073 None] Created volume successfully.
Nov 03 08:20:35 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b
Nov 03 08:20:35 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:35 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65.3ea951b3-0b96-4669-8177-8e6295c8379b" returned: 0 in 0.282s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-3ea951b3-0b96-4669-8177-8e6295c8379b" released by "_delete_snapshot" :: held 1.512s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Creating offline snapshot 2c2bf1ba-35ab-4bae-a45c-b6d4773919ec of volume ef5b61a2-6c82-46e4-b621-2c808d47fbff {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-ba300b6e-52de-4a4e-8757-5642b867bc65" released by "delete_snapshot" :: held 1.544s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f19fc70-774c-4fb5-bcc4-1a6ee39a9c2c]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Created reservations ['18978231-8224-4559-a96b-a20e96ad2d86', 'bfaf5d8e-1b0b-474f-b2a6-b0cdafadc37f', '312bdc3a-1510-4fca-8fb3-efc4971963b5', '74bc4494-46dd-46bc-97a3-cc4672b032b3'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:35 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Delete snapshot completed successfully.
Nov 03 08:20:35 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff
Nov 03 08:20:35 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f8bb9074-94dd-4df5-85d3-50693b85f28d tempest-ProjectReaderTests-1612162760 None] Lock "cinder-3ea951b3-0b96-4669-8177-8e6295c8379b-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:35 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff" returned: 0 in 0.360s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:35 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec 1G
Nov 03 08:20:35 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-ba300b6e-52de-4a4e-8757-5642b867bc65-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Lock "cinder-ba300b6e-52de-4a4e-8757-5642b867bc65-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:35 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Acquiring lock "cinder-quobyte-ba300b6e-52de-4a4e-8757-5642b867bc65" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-ba300b6e-52de-4a4e-8757-5642b867bc65" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d3d9dc-17a1-404e-9795-f644c3cb413f]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:36 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec 1G" returned: 0 in 0.445s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:36 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec
Nov 03 08:20:36 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:36 devstack sudo[107114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65
Nov 03 08:20:36 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:36 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:36 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65" returned: 0 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec" returned: 0 in 0.291s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:36 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec is being set with open permissions: ugo+rw
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:36 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65
Nov 03 08:20:36 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:36 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec
Nov 03 08:20:36 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:36 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:36 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec" returned: 0 in 0.241s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ba300b6e-52de-4a4e-8757-5642b867bc65" returned: 0 in 0.256s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Lock "cinder-quobyte-ba300b6e-52de-4a4e-8757-5642b867bc65" released by "delete_volume" :: held 0.710s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:36 devstack sudo[107130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.info
Nov 03 08:20:36 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Created reservations ['e1dfbe98-be9b-42ac-9aa8-3535bcdb9c17', 'd609107f-67c2-4f6a-a099-99b3e0d2fa6c', 'a6fd1633-66a4-43a4-aa16-7d44cf9f5ec6', '394790c9-be26-4c1a-9e63-2ae677629ee2'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:36 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:36 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:36 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:37 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.info" returned: 0 in 0.284s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:37 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.info is being set with open permissions: ugo+rw
Nov 03 08:20:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:37 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.info
Nov 03 08:20:37 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:37 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.261s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:37 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:37 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Deleted volume successfully.
Nov 03 08:20:37 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-17b56778-15e6-49c3-893e-e2eaeb4e0a9b tempest-ProjectReaderTests-1612162760 None] Lock "cinder-ba300b6e-52de-4a4e-8757-5642b867bc65-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:37 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.info" returned: 0 in 0.284s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:37 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:37 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8d2967ca-dc5b-4345-bbc7-2479bca0121e tempest-ProjectMemberTests-1029982073 None] Create snapshot completed successfully
Nov 03 08:20:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-2c2bf1ba-35ab-4bae-a45c-b6d4773919ec-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-2c2bf1ba-35ab-4bae-a45c-b6d4773919ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-ef5b61a2-6c82-46e4-b621-2c808d47fbff" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-ef5b61a2-6c82-46e4-b621-2c808d47fbff" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-2c2bf1ba-35ab-4bae-a45c-b6d4773919ec" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:38 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-2c2bf1ba-35ab-4bae-a45c-b6d4773919ec" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Deleting offline snapshot 2c2bf1ba-35ab-4bae-a45c-b6d4773919ec of volume ef5b61a2-6c82-46e4-b621-2c808d47fbff {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:38 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] snapshot_file for this snap is: volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:38 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8348714c-9d61-4931-9685-1596cce77cf4]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:38 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:38 devstack sudo[107173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec
Nov 03 08:20:38 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:39 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec" returned: 0 in 0.420s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:39 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:39 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d76a8f-6fe0-4ff8-8a0f-f7fc4522ec16]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:39 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff
Nov 03 08:20:39 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:39 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff" returned: 0 in 0.395s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:39 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec
Nov 03 08:20:39 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:39 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec" returned: 0 in 0.368s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:39 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:39 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec
Nov 03 08:20:39 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:40 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff.2c2bf1ba-35ab-4bae-a45c-b6d4773919ec" returned: 0 in 0.282s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-2c2bf1ba-35ab-4bae-a45c-b6d4773919ec" released by "_delete_snapshot" :: held 1.588s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-ef5b61a2-6c82-46e4-b621-2c808d47fbff" released by "delete_snapshot" :: held 1.617s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Created reservations ['91a52815-1281-4a9e-8663-15b85a3931e8', 'bf7ea3ab-d6fd-4670-a1e9-5a7b6bce253e', '46ca1e90-d2fa-4d79-9445-6a7d678122ab', '94f787e1-e693-40f4-8092-0c5d8f055e40'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:40 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Delete snapshot completed successfully.
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-4d7b33b7-fe3f-4f4d-9cf0-6ed0198ea958 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-2c2bf1ba-35ab-4bae-a45c-b6d4773919ec-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-ef5b61a2-6c82-46e4-b621-2c808d47fbff-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-ef5b61a2-6c82-46e4-b621-2c808d47fbff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-ef5b61a2-6c82-46e4-b621-2c808d47fbff" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-ef5b61a2-6c82-46e4-b621-2c808d47fbff" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a75f780-2075-4a69-8bee-4ede0ad41c2e]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:40 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:40 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff
Nov 03 08:20:40 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:41 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff" returned: 0 in 0.377s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:41 devstack sudo[107200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff
Nov 03 08:20:41 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:41 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ef5b61a2-6c82-46e4-b621-2c808d47fbff" returned: 0 in 0.266s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-ef5b61a2-6c82-46e4-b621-2c808d47fbff" released by "delete_volume" :: held 0.730s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Created reservations ['51309f9c-536f-4a46-bd4e-0a1e6134624e', '6d6f2ee8-660d-469d-ae81-74d9d8190a6f', '78d33d05-ee3a-4b46-8b67-22988b7d4078', '602e5d1b-0c0f-4fdd-8d99-d8db69c44790'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:41 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:41 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:41 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.270s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:41 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Deleted volume successfully.
Nov 03 08:20:41 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-9b29477d-6ff5-4aff-a430-e2680a8b6c07 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-ef5b61a2-6c82-46e4-b621-2c808d47fbff-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (f4cac62a-b2b4-4234-a8ad-ac631042560f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0761223f-6fee-465f-b2c6-067936fec420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0761223f-6fee-465f-b2c6-067936fec420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1747707734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c6f19c-540b-4f4f-90a8-8486f80ef572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:42Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c64a63-f57f-40cb-a19a-9faa894bcda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c64a63-f57f-40cb-a19a-9faa894bcda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31232cca-692d-4d5b-a5d8-2f596c2a7715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31232cca-692d-4d5b-a5d8-2f596c2a7715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c6f19c-540b-4f4f-90a8-8486f80ef572', 'volume_name': 'volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d58d78-3dd5-428e-8478-e43de4911cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d58d78-3dd5-428e-8478-e43de4911cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8445ac93-373e-4d0e-a233-6591ba6c0962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:42 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Volume c7c6f19c-540b-4f4f-90a8-8486f80ef572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572', 'volume_size': 1}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1747707734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c6f19c-540b-4f4f-90a8-8486f80ef572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:42Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Creating volume c7c6f19c-540b-4f4f-90a8-8486f80ef572 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:20:42 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:42 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 1073741824
Nov 03 08:20:42 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:42 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 1073741824" returned: 0 in 0.438s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:42 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:42 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572
Nov 03 08:20:42 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:43 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572" returned: 0 in 0.259s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:43 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:20:43 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:43 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=253,cinder:SELECT=205,cinder:DELETE=21,cinder:INSERT=72 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:20:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8445ac93-373e-4d0e-a233-6591ba6c0962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a8b27c-ca8f-43ff-b62c-951755cb882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:43 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Volume volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 (c7c6f19c-540b-4f4f-90a8-8486f80ef572): created successfully
Nov 03 08:20:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a8b27c-ca8f-43ff-b62c-951755cb882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:43 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (f4cac62a-b2b4-4234-a8ad-ac631042560f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:43 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-4b08ad62-cd53-4594-b7b6-158bc6f4a406 tempest-ProjectMemberTests-1029982073 None] Created volume successfully.
Nov 03 08:20:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:44 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Creating offline snapshot 64135904-6564-4e56-ae77-e5a17f92c482 of volume c7c6f19c-540b-4f4f-90a8-8486f80ef572 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:44 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[92268180-e5ec-4a26-a258-a72b7d55dc41]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:44 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:44 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572
Nov 03 08:20:44 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:45 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572" returned: 0 in 0.390s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:45 devstack sudo[107220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482 1G
Nov 03 08:20:45 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:45 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482 1G" returned: 0 in 0.500s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:45 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482
Nov 03 08:20:45 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:45 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482" returned: 0 in 0.403s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:45 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482 is being set with open permissions: ugo+rw
Nov 03 08:20:45 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:45 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482
Nov 03 08:20:45 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:46 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482" returned: 0 in 0.276s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:46 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.info
Nov 03 08:20:46 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:46 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.info" returned: 0 in 0.281s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:46 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.info is being set with open permissions: ugo+rw
Nov 03 08:20:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:46 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.info
Nov 03 08:20:46 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:46 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.info" returned: 0 in 0.264s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:46 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.211s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:46 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-2ca0525c-0cb2-47a3-bc4a-e46cab891849 tempest-ProjectMemberTests-1029982073 None] Create snapshot completed successfully
Nov 03 08:20:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-64135904-6564-4e56-ae77-e5a17f92c482-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-64135904-6564-4e56-ae77-e5a17f92c482-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-c7c6f19c-540b-4f4f-90a8-8486f80ef572" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-c7c6f19c-540b-4f4f-90a8-8486f80ef572" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-64135904-6564-4e56-ae77-e5a17f92c482" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:47 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-64135904-6564-4e56-ae77-e5a17f92c482" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Deleting offline snapshot 64135904-6564-4e56-ae77-e5a17f92c482 of volume c7c6f19c-540b-4f4f-90a8-8486f80ef572 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:47 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] snapshot_file for this snap is: volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:47 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35ff2c4-e7ea-46ff-ab0a-dfa147d9b5da]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:47 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:47 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482
Nov 03 08:20:47 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:48 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482" returned: 0 in 0.413s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:48 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:48 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3329c399-b771-4c43-a48f-26b3ee43c297]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:48 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572
Nov 03 08:20:48 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:48 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572" returned: 0 in 0.411s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:48 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:48 devstack sudo[107250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482
Nov 03 08:20:48 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:49 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482" returned: 0 in 0.356s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:49 devstack sudo[107255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482
Nov 03 08:20:49 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:49 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:49 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572.64135904-6564-4e56-ae77-e5a17f92c482" returned: 0 in 0.257s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-64135904-6564-4e56-ae77-e5a17f92c482" released by "_delete_snapshot" :: held 1.567s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-c7c6f19c-540b-4f4f-90a8-8486f80ef572" released by "delete_snapshot" :: held 1.593s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:49 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Created reservations ['fc773d90-290f-4472-a6e7-f2d16503c78e', '0d60a779-fb45-47a3-b660-8f894d53d795', 'a19b95dc-d5cb-4a36-815a-24e6442af26b', '0f3c82fa-18cb-45c9-8827-6ce775321472'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:49 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Delete snapshot completed successfully.
Nov 03 08:20:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-e1c4ff52-66e5-47c8-b80f-ff25003c70d2 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-64135904-6564-4e56-ae77-e5a17f92c482-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-c7c6f19c-540b-4f4f-90a8-8486f80ef572-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:49 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-c7c6f19c-540b-4f4f-90a8-8486f80ef572-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-c7c6f19c-540b-4f4f-90a8-8486f80ef572" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-c7c6f19c-540b-4f4f-90a8-8486f80ef572" acquired by "delete_volume" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca32bade-d9a4-4e3a-8839-40649f021406]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:50 devstack sudo[107258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572
Nov 03 08:20:50 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:50 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572" returned: 0 in 0.378s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:50 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572
Nov 03 08:20:50 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:50 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c7c6f19c-540b-4f4f-90a8-8486f80ef572" returned: 0 in 0.250s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-c7c6f19c-540b-4f4f-90a8-8486f80ef572" released by "delete_volume" :: held 0.705s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Created reservations ['2b1bce38-175a-4719-926c-57d9c3aaf3f0', 'd11b6fca-bd98-4079-a917-ae84fff888a5', 'da671186-c455-4371-adef-03fecc71f1ec', '36c653a7-57a2-47c6-814e-f5f7b76d8de5'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:50 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:50 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:20:50 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:51 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.267s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:20:51 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Deleted volume successfully.
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-85350822-d7b5-4a57-95b6-dec23efac522 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-c7c6f19c-540b-4f4f-90a8-8486f80ef572-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (44f7cd79-3f14-4086-871c-8719c2f24d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb344137-25b7-41d2-beed-1add2d211f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb344137-25b7-41d2-beed-1add2d211f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041270959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8f4fce-7095-4f95-8d3c-f29a63bbd09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:52Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7cbb24-89b8-45f9-8bfd-e14ebc552deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7cbb24-89b8-45f9-8bfd-e14ebc552deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286b0eae-5bd6-4794-9c0d-cc745f6f152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286b0eae-5bd6-4794-9c0d-cc745f6f152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8f4fce-7095-4f95-8d3c-f29a63bbd09a', 'volume_name': 'volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395d5b3e-be5d-4cab-a1c1-81faac74975d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395d5b3e-be5d-4cab-a1c1-81faac74975d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3d2686-9324-4fb1-8472-c00330a8a0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:51 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Volume 1c8f4fce-7095-4f95-8d3c-f29a63bbd09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a', 'volume_size': 1}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041270959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8f4fce-7095-4f95-8d3c-f29a63bbd09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:52Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Creating volume 1c8f4fce-7095-4f95-8d3c-f29a63bbd09a {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:20:51 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:20:51 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:51 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a 1073741824
Nov 03 08:20:51 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:52 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a 1073741824" returned: 0 in 0.465s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:52 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a
Nov 03 08:20:52 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:52 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" returned: 0 in 0.271s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:52 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:20:52 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3d2686-9324-4fb1-8472-c00330a8a0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0f2075-609d-46ed-9adb-c4bfac3877d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:20:52 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Volume volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a (1c8f4fce-7095-4f95-8d3c-f29a63bbd09a): created successfully
Nov 03 08:20:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0f2075-609d-46ed-9adb-c4bfac3877d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:20:52 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (44f7cd79-3f14-4086-871c-8719c2f24d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:20:52 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-049fa424-a111-48c2-beb7-2b10f3d77cf6 tempest-ProjectMemberTests-1029982073 None] Created volume successfully.
Nov 03 08:20:53 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=223,cinder:DELETE=19,cinder:SELECT=157,cinder:INSERT=58 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:20:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:20:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:20:53 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Creating offline snapshot 3e00a1c5-02cb-4730-aa9d-3fed98605325 of volume 1c8f4fce-7095-4f95-8d3c-f29a63bbd09a {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:20:53 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ed6e03-9f50-4d64-9db9-7f627601fe7d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:53 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:53 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a
Nov 03 08:20:53 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:54 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" returned: 0 in 0.385s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:54 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325 1G
Nov 03 08:20:54 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:54 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325 1G" returned: 0 in 0.448s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:54 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325
Nov 03 08:20:54 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:55 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325" returned: 0 in 0.322s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:55 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325 is being set with open permissions: ugo+rw
Nov 03 08:20:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:55 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325
Nov 03 08:20:55 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:55 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325" returned: 0 in 0.287s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:55 devstack sudo[107298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.info
Nov 03 08:20:55 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:55 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.info" returned: 0 in 0.270s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:55 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.info is being set with open permissions: ugo+rw
Nov 03 08:20:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:55 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.info
Nov 03 08:20:55 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:55 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.info" returned: 0 in 0.274s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:55 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:20:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-ff61ed6e-ec89-4e5f-90c0-d710c4f3d77a tempest-ProjectMemberTests-1029982073 None] Create snapshot completed successfully
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-3e00a1c5-02cb-4730-aa9d-3fed98605325-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-3e00a1c5-02cb-4730-aa9d-3fed98605325-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-3e00a1c5-02cb-4730-aa9d-3fed98605325" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-3e00a1c5-02cb-4730-aa9d-3fed98605325" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Deleting offline snapshot 3e00a1c5-02cb-4730-aa9d-3fed98605325 of volume 1c8f4fce-7095-4f95-8d3c-f29a63bbd09a {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] snapshot_file for this snap is: volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9380b06-a9e5-4b23-9c60-18bf7a2dfa9a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:57 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325
Nov 03 08:20:57 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:57 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325" returned: 0 in 0.401s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d91777-15a7-4c5d-84d0-06227b283aaf]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:57 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a
Nov 03 08:20:57 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:57 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" returned: 0 in 0.394s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:57 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:58 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325
Nov 03 08:20:58 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:58 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325" returned: 0 in 0.344s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:58 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325
Nov 03 08:20:58 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:58 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:58 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a.3e00a1c5-02cb-4730-aa9d-3fed98605325" returned: 0 in 0.248s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-3e00a1c5-02cb-4730-aa9d-3fed98605325" released by "_delete_snapshot" :: held 1.529s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" released by "delete_snapshot" :: held 1.553s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:58 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Created reservations ['7b4dc02d-cea0-43c2-ad78-9df4bbd83811', '05f85d4f-79f7-46dd-914a-d468185a534d', '63aac71c-91db-47c5-8b42-d9b765655826', 'aa1f91ee-beac-45b2-ac5a-6e2f2f8ed7c4'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:20:58 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Delete snapshot completed successfully.
Nov 03 08:20:58 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-bc5253a1-b73d-4e30-aa64-7c29ac7f6284 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-3e00a1c5-02cb-4730-aa9d-3fed98605325-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:20:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:20:59 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" acquired by "delete_volume" :: waited 0.032s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:20:59 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5285dceb-0df1-4119-90fd-c0d9e8711260]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:20:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:59 devstack sudo[107323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a
Nov 03 08:20:59 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:20:59 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root
Nov 03 08:20:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" returned: 0 in 0.433s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:20:59 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:20:59 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a
Nov 03 08:20:59 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:00 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" returned: 0 in 0.294s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a" released by "delete_volume" :: held 0.854s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Created reservations ['e89e37c3-7fe4-42a3-9584-444be7026d48', '5763c0c7-fb3c-4190-9a9e-a29b9a374c52', '6db8aa53-80e0-42c7-a98c-64f9d2bf3c61', 'e1c94d94-d838-4f24-93bc-a4ddae82769b'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:00 devstack sudo[107331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:21:00 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:00 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.259s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:21:00 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Deleted volume successfully.
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-cff4be19-ed47-4551-93b6-d72056cb8a93 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-1c8f4fce-7095-4f95-8d3c-f29a63bbd09a-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Flow 'volume_create_manager' (a38fe5fd-3d3c-4abb-b077-ca3cea8ac11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0877d6dd-d952-4a1a-8e2a-5ec59ff1383e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0877d6dd-d952-4a1a-8e2a-5ec59ff1383e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1420142951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7050cbc2-f2e4-443d-bbbf-194630c33a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9773adbee4040a5aa2ea802d86ac988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:01Z,use_quota=True,user_id='a50221c341f64e8c8a7efcc8b7239bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a316dd7c-cc02-433e-8e8a-c371d9f7f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a316dd7c-cc02-433e-8e8a-c371d9f7f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583a81af-ef2f-4c65-b6fc-14e73ad10a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583a81af-ef2f-4c65-b6fc-14e73ad10a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7050cbc2-f2e4-443d-bbbf-194630c33a1a', 'volume_name': 'volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31559293-7318-46cc-9f17-82f23914faf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31559293-7318-46cc-9f17-82f23914faf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc47103-a6e3-4282-ab84-f2fe71425a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:00 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Volume 7050cbc2-f2e4-443d-bbbf-194630c33a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a', 'volume_size': 1}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1420142951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7050cbc2-f2e4-443d-bbbf-194630c33a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9773adbee4040a5aa2ea802d86ac988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:01Z,use_quota=True,user_id='a50221c341f64e8c8a7efcc8b7239bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Creating volume 7050cbc2-f2e4-443d-bbbf-194630c33a1a {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:21:00 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:00 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a 1073741824
Nov 03 08:21:00 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (50b49895-cfeb-4c5f-a650-dbe1a75b4f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434cc305-ac3a-4611-a128-5382e1df3b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434cc305-ac3a-4611-a128-5382e1df3b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334567225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c293488c-7074-46da-9a5f-ec45360cc1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:01Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bda457-608e-4899-8c60-c98a9cfb22c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bda457-608e-4899-8c60-c98a9cfb22c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:00 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd719ee-6fe2-45d6-9a42-5be947f69a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd719ee-6fe2-45d6-9a42-5be947f69a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c293488c-7074-46da-9a5f-ec45360cc1f8', 'volume_name': 'volume-c293488c-7074-46da-9a5f-ec45360cc1f8', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb962025-3211-42a8-856a-837f846362ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb962025-3211-42a8-856a-837f846362ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14bf392-44a3-45c5-bee0-d6c5a1c92259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:01 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Volume c293488c-7074-46da-9a5f-ec45360cc1f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c293488c-7074-46da-9a5f-ec45360cc1f8', 'volume_size': 1}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:01 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a 1073741824" returned: 0 in 0.419s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:01 devstack sudo[107339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a
Nov 03 08:21:01 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:01 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a" returned: 0 in 0.244s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334567225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c293488c-7074-46da-9a5f-ec45360cc1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10281170e9104736b156bdfaebf6b5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:01Z,use_quota=True,user_id='d2edeb87572245918de023a6da10de96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Creating volume c293488c-7074-46da-9a5f-ec45360cc1f8 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:21:01 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:01 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8 1073741824
Nov 03 08:21:01 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc47103-a6e3-4282-ab84-f2fe71425a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2818c1c-fc9b-4f83-b293-e8002a33ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:01 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Volume volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a (7050cbc2-f2e4-443d-bbbf-194630c33a1a): created successfully
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2818c1c-fc9b-4f83-b293-e8002a33ff18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Flow 'volume_create_manager' (a38fe5fd-3d3c-4abb-b077-ca3cea8ac11a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:21:01 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-1f21c1a0-590f-41f9-9863-64b7a441c719 tempest-SnapshotDependencyTests-1584385518 None] Created volume successfully.
Nov 03 08:21:01 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:01 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8 1073741824" returned: 0 in 0.409s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:02 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8
Nov 03 08:21:02 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:02 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8" returned: 0 in 0.237s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:02 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:21:02 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14bf392-44a3-45c5-bee0-d6c5a1c92259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c293488c-7074-46da-9a5f-ec45360cc1f8', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b3419f-9895-48b2-8356-9650e80536f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:02 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Volume volume-c293488c-7074-46da-9a5f-ec45360cc1f8 (c293488c-7074-46da-9a5f-ec45360cc1f8): created successfully
Nov 03 08:21:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b3419f-9895-48b2-8356-9650e80536f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:02 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Flow 'volume_create_manager' (50b49895-cfeb-4c5f-a650-dbe1a75b4f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:21:02 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e249467a-7c6d-4978-91a0-e70c7eee0664 tempest-ProjectMemberTests-1029982073 None] Created volume successfully.
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Creating offline snapshot 4dd17a07-bf80-4723-8eae-1879963f440d of volume 7050cbc2-f2e4-443d-bbbf-194630c33a1a {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff689ad-2b2a-4f6d-88d1-6aee0ebce667]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:03 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a
Nov 03 08:21:03 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:03 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:21:03 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:03 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.243s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:21:03 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_service.periodic_task [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] Running periodic task VolumeManager._thread_info {{(pid=86851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread count: 28 {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-915a889f-18c5-461d-9e4e-20de66dbbf6f None None] thread info: [<_MainThread(MainThread, started 137741594366080)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137741480810048)>, <Thread(Thread-3 (stat_writer), started daemon 137741483717888)>, <Thread(Rabbit-heartbeat, started daemon 137741482028224)>, <Thread(Thread-5 (_runner), started daemon 137741480204544)>, <Thread(Thread-7 (_runner), started daemon 137741478221440)>, <Thread(fd_logger, started daemon 137741476044672)>, <Thread(privsep_reader, started daemon 137741474608000)>, <Thread(tpool_thread_0, started daemon 137741470648000)>, <Thread(tpool_thread_1, started daemon 137741462255296)>, <Thread(tpool_thread_2, started daemon 137741453862592)>, <Thread(tpool_thread_3, started daemon 137741445453504)>, <Thread(tpool_thread_4, started daemon 137741437044416)>, <Thread(tpool_thread_5, started daemon 137741428635328)>, <Thread(tpool_thread_6, started daemon 137741420226240)>, <Thread(tpool_thread_7, started daemon 137741411817152)>, <Thread(tpool_thread_8, started daemon 137741403408064)>, <Thread(tpool_thread_9, started daemon 137741394998976)>, <Thread(tpool_thread_10, started daemon 137741386589888)>, <Thread(tpool_thread_11, started daemon 137741378180800)>, <Thread(tpool_thread_12, started daemon 137741369771712)>, <Thread(tpool_thread_13, started daemon 137741361362624)>, <Thread(tpool_thread_14, started daemon 137741352953536)>, <Thread(tpool_thread_15, started daemon 137741344544448)>, <Thread(tpool_thread_16, started daemon 137741336135360)>, <Thread(tpool_thread_17, started daemon 137741327726272)>, <Thread(tpool_thread_18, started daemon 137741319317184)>, <Thread(tpool_thread_19, started daemon 137741310908096)>] {{(pid=86851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a" returned: 0 in 0.389s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:03 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d 1G
Nov 03 08:21:03 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:03 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d 1G" returned: 0 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:03 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:03 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d
Nov 03 08:21:03 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:04 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d" returned: 0 in 0.283s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:04 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d is being set with open permissions: ugo+rw
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:04 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d
Nov 03 08:21:04 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:04 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d" returned: 0 in 0.239s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:04 devstack sudo[107373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.info
Nov 03 08:21:04 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:04 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.info" returned: 0 in 0.247s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:04 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.info is being set with open permissions: ugo+rw
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:04 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.info
Nov 03 08:21:04 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:04 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.info" returned: 0 in 0.231s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.785s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Creating offline snapshot fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 of volume c293488c-7074-46da-9a5f-ec45360cc1f8 {{(pid=86851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 08:21:04 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-6b307191-66b1-422a-8961-235a714230e7 tempest-SnapshotDependencyTests-1584385518 None] Create snapshot completed successfully
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[200683b1-d221-4f81-a9e3-5fccfa0444dc]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:04 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:05 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8
Nov 03 08:21:05 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:05 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8" returned: 0 in 0.369s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 1G {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:05 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 1G
Nov 03 08:21:05 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:21:05 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 1G" returned: 0 in 0.443s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c293488c-7074-46da-9a5f-ec45360cc1f8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:05 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c293488c-7074-46da-9a5f-ec45360cc1f8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3
Nov 03 08:21:05 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Flow 'volume_create_manager' (b15626f4-9c7a-4feb-b5dd-7e95380ad131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e252b7-20f8-47dc-8eb5-eae33f8c7545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e252b7-20f8-47dc-8eb5-eae33f8c7545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea439f96-199c-4d93-9d4d-045546683576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9773adbee4040a5aa2ea802d86ac988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4dd17a07-bf80-4723-8eae-1879963f440d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:06Z,use_quota=True,user_id='a50221c341f64e8c8a7efcc8b7239bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6800e8b6-7997-4d59-a774-21b9105307ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6800e8b6-7997-4d59-a774-21b9105307ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0f5166-b773-48b8-841c-3d0c1c16f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0f5166-b773-48b8-841c-3d0c1c16f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea439f96-199c-4d93-9d4d-045546683576', 'volume_name': 'volume-ea439f96-199c-4d93-9d4d-045546683576', 'volume_size': 1, 'snapshot_id': '4dd17a07-bf80-4723-8eae-1879963f440d'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447988ef-a9c9-4f63-8110-a790cc23350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447988ef-a9c9-4f63-8110-a790cc23350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac1e8f3-740d-4e1d-b7c3-6bd851c2dffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:05 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Volume ea439f96-199c-4d93-9d4d-045546683576: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea439f96-199c-4d93-9d4d-045546683576', 'volume_size': 1, 'snapshot_id': '4dd17a07-bf80-4723-8eae-1879963f440d'}
Nov 03 08:21:05 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:06 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c293488c-7074-46da-9a5f-ec45360cc1f8 -F qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3" returned: 0 in 0.286s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:06 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 is being set with open permissions: ugo+rw
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:06 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3
Nov 03 08:21:06 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:06 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3" returned: 0 in 0.244s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:06 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.info
Nov 03 08:21:06 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:06 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.info" returned: 0 in 0.241s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:06 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.info is being set with open permissions: ugo+rw
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.info {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:06 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.info
Nov 03 08:21:06 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:06 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.info" returned: 0 in 0.240s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.953s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "cinder-quobyte-4dd17a07-bf80-4723-8eae-1879963f440d-ea439f96-199c-4d93-9d4d-045546683576" by "_create_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-4dd17a07-bf80-4723-8eae-1879963f440d-ea439f96-199c-4d93-9d4d-045546683576" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Creating volume ea439f96-199c-4d93-9d4d-045546683576 from snapshot 4dd17a07-bf80-4723-8eae-1879963f440d {{(pid=86851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "cinder-quobyte-ea439f96-199c-4d93-9d4d-045546683576" by "_copy_volume_from_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:06 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-bf41b92b-71b8-4fc3-9d3a-e3180e92b2b3 tempest-ProjectMemberTests-1029982073 None] Create snapshot completed successfully
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-ea439f96-199c-4d93-9d4d-045546683576" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] snapshot: 4dd17a07-bf80-4723-8eae-1879963f440d, volume: ea439f96-199c-4d93-9d4d-045546683576,  {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae215c0-b53c-4579-834d-9d0b1c0167b3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:06 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:07 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d
Nov 03 08:21:07 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:07 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d" returned: 0 in 0.360s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fc4863-532d-4670-962c-856b75036503]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:07 devstack sudo[107410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a
Nov 03 08:21:07 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-fb1d138f-1701-4eb9-b5bc-18c3012c7ab3-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-fb1d138f-1701-4eb9-b5bc-18c3012c7ab3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-c293488c-7074-46da-9a5f-ec45360cc1f8" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-c293488c-7074-46da-9a5f-ec45360cc1f8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-fb1d138f-1701-4eb9-b5bc-18c3012c7ab3" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-fb1d138f-1701-4eb9-b5bc-18c3012c7ab3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Deleting offline snapshot fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 of volume c293488c-7074-46da-9a5f-ec45360cc1f8 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] snapshot_file for this snap is: volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb49720-af32-403e-a2c9-88d2e52b8f6d]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:07 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3
Nov 03 08:21:07 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:07 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a" returned: 0 in 0.399s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Creating direct copy from snapshot {{(pid=86851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.utils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Path /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576 not found in is_blk_device check {{(pid=86851) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:07 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576
Nov 03 08:21:07 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:07 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3" returned: 0 in 0.369s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c293488c-7074-46da-9a5f-ec45360cc1f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eff5f3-6729-4779-b640-77fceab1daf3]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:07 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:08 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8
Nov 03 08:21:08 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:08 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8" returned: 0 in 0.469s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:08 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:08 devstack sudo[107438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3
Nov 03 08:21:08 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:09 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3" returned: 0 in 0.635s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:09 devstack sudo[107444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3
Nov 03 08:21:09 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:09 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:09 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8.fb1d138f-1701-4eb9-b5bc-18c3012c7ab3" returned: 0 in 0.408s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-fb1d138f-1701-4eb9-b5bc-18c3012c7ab3" released by "_delete_snapshot" :: held 2.011s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-c293488c-7074-46da-9a5f-ec45360cc1f8" released by "delete_snapshot" :: held 2.036s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:09 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Created reservations ['68997b6d-20af-4f81-ade6-39680b62a07e', 'e39aefe0-3b13-4fe4-bd6b-7090cd0c6b72', '12e4d4b2-7e37-49fa-b783-9aa0bffe5515', 'b52e18f9-2e36-4b3a-b559-ee3b07d6d1a4'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:21:09 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Delete snapshot completed successfully.
Nov 03 08:21:09 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-f7284beb-f18f-4c9b-bbd7-65f5fbede259 tempest-ProjectMemberTests-1029982073 None] Lock "cinder-fb1d138f-1701-4eb9-b5bc-18c3012c7ab3-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-c293488c-7074-46da-9a5f-ec45360cc1f8-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Lock "cinder-c293488c-7074-46da-9a5f-ec45360cc1f8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Acquiring lock "cinder-quobyte-c293488c-7074-46da-9a5f-ec45360cc1f8" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:10 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-c293488c-7074-46da-9a5f-ec45360cc1f8" acquired by "delete_volume" :: waited 0.020s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:10 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3658227-4c64-4d38-a8aa-26bafa39ecfb]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:10 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:11 devstack sudo[107447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8
Nov 03 08:21:11 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:11 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8" returned: 0 in 0.557s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:11 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8
Nov 03 08:21:11 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:11 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:11 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-c293488c-7074-46da-9a5f-ec45360cc1f8" returned: 0 in 0.357s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:11 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Lock "cinder-quobyte-c293488c-7074-46da-9a5f-ec45360cc1f8" released by "delete_volume" :: held 1.035s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:12 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Created reservations ['98d39c84-9cb5-4ece-8ef5-d3900091a992', '98a6ccfe-6da7-4280-bb91-8a327234789c', 'b2117b2c-ee11-4d7d-b8e5-7f2750a6ec5e', '8162c529-1677-4e9b-ada4-f716de903a46'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:21:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:12 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:12 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:21:12 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:12 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:12 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.420s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:12 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:21:12 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Deleted volume successfully.
Nov 03 08:21:12 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-eddeae78-dc62-4d8c-92f7-f49302fc927e tempest-ProjectMemberTests-1029982073 None] Lock "cinder-c293488c-7074-46da-9a5f-ec45360cc1f8-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:14 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576" returned: 0 in 6.652s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG cinder.image.image_utils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Image conversion details: src /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576 {{(pid=86851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 08:21:14 devstack cinder-volume[86851]: INFO cinder.image.image_utils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Converted 1024.00 MB image at 153.91 MB/s
Nov 03 08:21:14 devstack cinder-volume[86851]: WARNING cinder.volume.drivers.remotefs [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576 is being set with open permissions: ugo+rw
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:14 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576
Nov 03 08:21:14 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:14 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576" returned: 0 in 0.250s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-ea439f96-199c-4d93-9d4d-045546683576" released by "_copy_volume_from_snapshot" :: held 7.748s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-4dd17a07-bf80-4723-8eae-1879963f440d-ea439f96-199c-4d93-9d4d-045546683576" released by "_create_volume_from_snapshot" :: held 7.815s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.840s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac1e8f3-740d-4e1d-b7c3-6bd851c2dffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea439f96-199c-4d93-9d4d-045546683576', 'volume_size': 1, 'snapshot_id': '4dd17a07-bf80-4723-8eae-1879963f440d'}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6fabef-25c5-4b4d-8a91-9502d5bc9844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:14 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Volume volume-ea439f96-199c-4d93-9d4d-045546683576 (ea439f96-199c-4d93-9d4d-045546683576): created successfully
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6fabef-25c5-4b4d-8a91-9502d5bc9844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:14 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Flow 'volume_create_manager' (b15626f4-9c7a-4feb-b5dd-7e95380ad131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:21:14 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-c65dc4b0-0219-4763-b461-b44c51d577cb tempest-SnapshotDependencyTests-1584385518 None] Created volume successfully.
Nov 03 08:21:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "cinder-4dd17a07-bf80-4723-8eae-1879963f440d-delete_snapshot" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-4dd17a07-bf80-4723-8eae-1879963f440d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "cinder-quobyte-7050cbc2-f2e4-443d-bbbf-194630c33a1a" by "delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-7050cbc2-f2e4-443d-bbbf-194630c33a1a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "cinder-quobyte-4dd17a07-bf80-4723-8eae-1879963f440d" by "_delete_snapshot" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:15 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-4dd17a07-bf80-4723-8eae-1879963f440d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Deleting offline snapshot 4dd17a07-bf80-4723-8eae-1879963f440d of volume 7050cbc2-f2e4-443d-bbbf-194630c33a1a {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 08:21:15 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] snapshot_file for this snap is: volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d {{(pid=86851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 08:21:15 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[12de5e39-44ab-41f9-bc2b-83d58f1bab68]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:15 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:15 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d
Nov 03 08:21:15 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:15 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d" returned: 0 in 0.369s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:16 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 08:21:16 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e412caf-facf-4244-a318-c387ea232622]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:16 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a
Nov 03 08:21:16 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:16 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a" returned: 0 in 0.541s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:16 devstack sudo[107474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d
Nov 03 08:21:16 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:16 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d" returned: 0 in 0.352s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:16 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:16 devstack sudo[107479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d
Nov 03 08:21:16 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:17 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a.4dd17a07-bf80-4723-8eae-1879963f440d" returned: 0 in 0.262s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-4dd17a07-bf80-4723-8eae-1879963f440d" released by "_delete_snapshot" :: held 1.651s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-7050cbc2-f2e4-443d-bbbf-194630c33a1a" released by "delete_snapshot" :: held 1.678s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Created reservations ['d7dc87bc-c3eb-40dd-bc63-d8da62f111c9', '6676ea7d-fa72-4832-9e21-0dbf68c0a40a', '4cc3cfc6-cbb3-4c28-8653-6f3ca3dd6749', 'ff4e861c-2328-4cd4-a61b-ebacc62cdb8e'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:21:17 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Delete snapshot completed successfully.
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-b77467ce-7925-4ecb-a443-af4ac552c799 tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-4dd17a07-bf80-4723-8eae-1879963f440d-delete_snapshot" released by "delete_snapshot" :: held 1.846s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Flow 'volume_create_manager' (7bd3f770-1a34-4dd1-be8f-7af51e0c86ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c1ddca-91c5-486c-909c-556d198290cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c1ddca-91c5-486c-909c-556d198290cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990401105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f2231a-d254-471c-afef-70f461cc6799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5825483667a246eb98628622d71e58a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:17Z,use_quota=True,user_id='ec04036c01c84315b1dd04e08afa5515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec4a672-11db-4732-9280-afa672d34630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec4a672-11db-4732-9280-afa672d34630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716fbc9d-7bcd-4b9d-af6a-cdd8e8fa8c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716fbc9d-7bcd-4b9d-af6a-cdd8e8fa8c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f2231a-d254-471c-afef-70f461cc6799', 'volume_name': 'volume-35f2231a-d254-471c-afef-70f461cc6799', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710b694e-d7a3-4354-8ffb-ad2daaec6b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710b694e-d7a3-4354-8ffb-ad2daaec6b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0143d5-a83a-4b19-a53b-0e3336a7a7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:17 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Volume 35f2231a-d254-471c-afef-70f461cc6799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f2231a-d254-471c-afef-70f461cc6799', 'volume_size': 1}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990401105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f2231a-d254-471c-afef-70f461cc6799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5825483667a246eb98628622d71e58a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:17Z,use_quota=True,user_id='ec04036c01c84315b1dd04e08afa5515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Creating volume 35f2231a-d254-471c-afef-70f461cc6799 {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:21:17 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:17 devstack sudo[107482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799 1073741824
Nov 03 08:21:17 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "cinder-7050cbc2-f2e4-443d-bbbf-194630c33a1a-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-7050cbc2-f2e4-443d-bbbf-194630c33a1a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "cinder-quobyte-7050cbc2-f2e4-443d-bbbf-194630c33a1a" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-7050cbc2-f2e4-443d-bbbf-194630c33a1a" acquired by "delete_volume" :: waited 0.018s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3193965d-67f3-487f-98e5-4901a0d33411]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:17 devstack sudo[107487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a
Nov 03 08:21:17 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:17 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799 1073741824" returned: 0 in 0.449s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:17 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:18 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799
Nov 03 08:21:18 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:18 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a" returned: 0 in 0.387s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:18 devstack sudo[107496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a
Nov 03 08:21:18 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:18 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799" returned: 0 in 0.260s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0143d5-a83a-4b19-a53b-0e3336a7a7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f2231a-d254-471c-afef-70f461cc6799', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603550b6-8673-4914-bacf-0a3ef8311807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:18 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Volume volume-35f2231a-d254-471c-afef-70f461cc6799 (35f2231a-d254-471c-afef-70f461cc6799): created successfully
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603550b6-8673-4914-bacf-0a3ef8311807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Flow 'volume_create_manager' (7bd3f770-1a34-4dd1-be8f-7af51e0c86ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:21:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-8858e062-840a-49cd-b360-00b55d77f10d tempest-ProjectReaderTests-1754708557 None] Created volume successfully.
Nov 03 08:21:18 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-7050cbc2-f2e4-443d-bbbf-194630c33a1a" returned: 0 in 0.257s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-7050cbc2-f2e4-443d-bbbf-194630c33a1a" released by "delete_volume" :: held 0.703s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Created reservations ['f60f6e66-9dc1-41c7-8608-b448d5c9acf1', '4fcecac1-74bf-44ed-9d64-7b9b9b1aac7a', 'e44257eb-5807-4703-9bcc-f4e39e43e6c8', '17a2c82e-2b5c-4f9d-baca-a381d5d3b1ee'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Acquiring lock "cinder-35f2231a-d254-471c-afef-70f461cc6799-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Lock "cinder-35f2231a-d254-471c-afef-70f461cc6799-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:18 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:21:18 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Acquiring lock "cinder-quobyte-35f2231a-d254-471c-afef-70f461cc6799" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Lock "cinder-quobyte-35f2231a-d254-471c-afef-70f461cc6799" acquired by "delete_volume" :: waited 0.017s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0434188f-f003-4bdc-aac8-4a3699e91c8a]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:18 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799
Nov 03 08:21:18 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "cinder-ea439f96-199c-4d93-9d4d-045546683576-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:18 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.268s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-ea439f96-199c-4d93-9d4d-045546683576-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:18 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Deleted volume successfully.
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d6422301-2655-46f8-b6c6-31a80ce08afd tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-7050cbc2-f2e4-443d-bbbf-194630c33a1a-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "cinder-quobyte-ea439f96-199c-4d93-9d4d-045546683576" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-ea439f96-199c-4d93-9d4d-045546683576" acquired by "delete_volume" :: waited 0.014s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93c4bce-7d5a-4808-95df-40fa99d09974]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:18 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:19 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576
Nov 03 08:21:19 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:19 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799" returned: 0 in 0.431s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:19 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799
Nov 03 08:21:19 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:19 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576" returned: 0 in 0.367s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:19 devstack sudo[107521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576
Nov 03 08:21:19 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:19 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-35f2231a-d254-471c-afef-70f461cc6799" returned: 0 in 0.272s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Lock "cinder-quobyte-35f2231a-d254-471c-afef-70f461cc6799" released by "delete_volume" :: held 0.749s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Created reservations ['bc49575d-d138-4528-bba3-9effebe9bb2e', '01397532-4757-4339-aff4-4bbbe170579c', '028d30a0-9f35-4a4c-9e56-b339b171bb1f', '4672cddd-bf68-4433-87fe-ae3edbc3ab79'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:19 devstack sudo[107525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:21:19 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:19 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-ea439f96-199c-4d93-9d4d-045546683576" returned: 0 in 0.245s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-quobyte-ea439f96-199c-4d93-9d4d-045546683576" released by "delete_volume" :: held 0.656s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Created reservations ['54e747f1-d1a5-4e08-b418-8bc41373fd5d', '3c154cb1-a66b-443c-b0c5-0ecf6a716626', '1f21fb4b-d722-4a82-b9e9-12eeccdaebde', 'a7e129ef-3aea-4bac-8779-37621bf37b6c'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:19 devstack sudo[107527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:21:19 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:19 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.294s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:21:19 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Deleted volume successfully.
Nov 03 08:21:19 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-87df1865-84e8-4087-9e09-23d7cbfefe15 tempest-ProjectReaderTests-1754708557 None] Lock "cinder-35f2231a-d254-471c-afef-70f461cc6799-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:20 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.280s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:21:20 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Deleted volume successfully.
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-7f0b40a9-06a0-4baa-9365-bfec0aca045d tempest-SnapshotDependencyTests-1584385518 None] Lock "cinder-ea439f96-199c-4d93-9d4d-045546683576-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Flow 'volume_create_manager' (5001bd5f-2e8f-48e9-8e32-1ba6bce04b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c4bc46-cb84-44b2-a2fa-09d26e3aa7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c4bc46-cb84-44b2-a2fa-09d26e3aa7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1348610029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5825483667a246eb98628622d71e58a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:20Z,use_quota=True,user_id='ec04036c01c84315b1dd04e08afa5515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da66f9ea-e21b-4656-ac80-6963d87833ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da66f9ea-e21b-4656-ac80-6963d87833ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309c4313-2567-4503-8605-223eadbb1459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309c4313-2567-4503-8605-223eadbb1459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc', 'volume_name': 'volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa64f465-616c-494b-81a2-51c5be64ce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa64f465-616c-494b-81a2-51c5be64ce63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3b31c9-63df-471f-a356-a431e545623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:20 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Volume 6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc', 'volume_size': 1}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d467095cb30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T07:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1348610029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5825483667a246eb98628622d71e58a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:20Z,use_quota=True,user_id='ec04036c01c84315b1dd04e08afa5515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b9e985b-a4f2-421c-81f6-098f480b9840),volume_type_id=0b9e985b-a4f2-421c-81f6-098f480b9840)}" {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.remotefs [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Creating volume 6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc {{(pid=86851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Selected osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10 as target Quobyte volume. {{(pid=86851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 08:21:20 devstack cinder-volume[86851]: INFO cinder.volume.drivers.remotefs [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] casted to osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc 1073741824 {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:20 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc 1073741824
Nov 03 08:21:20 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:20 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc 1073741824" returned: 0 in 0.455s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:20 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:20 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc
Nov 03 08:21:20 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:21 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc" returned: 0 in 0.258s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:21 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'} {{(pid=86851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 08:21:21 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3b31c9-63df-471f-a356-a431e545623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc', 'volume_size': 1}' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ec77c3-796d-45a5-8308-ee4efd8ca415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 08:21:21 devstack cinder-volume[86851]: INFO cinder.volume.flows.manager.create_volume [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Volume volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc (6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc): created successfully
Nov 03 08:21:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ec77c3-796d-45a5-8308-ee4efd8ca415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 08:21:21 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Flow 'volume_create_manager' (5001bd5f-2e8f-48e9-8e32-1ba6bce04b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 08:21:21 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-e466ec58-a840-4194-8565-cac664b84fda tempest-ProjectReaderTests-1754708557 None] Created volume successfully.
Nov 03 08:21:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Acquiring lock "cinder-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc-delete_volume" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Lock "cinder-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Acquiring lock "cinder-quobyte-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc" by "delete_volume" {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 08:21:22 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Lock "cinder-quobyte-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc" acquired by "delete_volume" :: waited 0.021s {{(pid=86851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 08:21:22 devstack cinder-volume[86851]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e89973-37b9-4f7e-b20c-f74859e984d1]: (4, 'qcow2') {{(pid=89540) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 08:21:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:22 devstack sudo[107541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc
Nov 03 08:21:22 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:22 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc" returned: 0 in 0.361s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:22 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:22 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc
Nov 03 08:21:22 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:23 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f/volume-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc" returned: 0 in 0.246s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Lock "cinder-quobyte-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc" released by "delete_volume" :: held 0.655s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG cinder.quota [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Created reservations ['4adaf50a-ec21-415d-aa43-97ed71abfa57', 'f0d794da-a1e6-4beb-a6ca-a2866a707394', 'eeae11f3-9402-489c-afcc-759f0a07f3b1', 'c20e63fa-f066-45d8-a083-16e8b0e7a853'] {{(pid=86851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10': None} {{(pid=86851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG cinder.volume.drivers.quobyte [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8625f14b-aba6-4601-aeb0-078608aacd10'] {{(pid=86851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 08:21:23 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f
Nov 03 08:21:23 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 08:21:23 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG oslo_concurrency.processutils [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a87de23d9d9f6a6a8ad95f733cac609f" returned: 0 in 0.309s {{(pid=86851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG cinder.manager [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Notifying Schedulers of capabilities ... {{(pid=86851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 08:21:23 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Deleted volume successfully.
Nov 03 08:21:23 devstack cinder-volume[86851]: DEBUG cinder.coordination [None req-d1c06f3d-33d7-4eb8-929b-4f243e2887bb tempest-ProjectReaderTests-1754708557 None] Lock "cinder-6dc0a7dd-f19d-458e-91a0-6c0cbf16c4dc-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 08:21:33 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=80,cinder:UPDATE=92,cinder:INSERT=29,cinder:DELETE=9 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 08:21:33 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:UPDATE=92,cinder:SELECT=64,cinder:DELETE=7,cinder:INSERT=19 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}